Questions tagged [character-set]
The character-set tag has no usage guidance.
1
vote
1answer
27 views
MySQL utf8mb4 Migration - Replication Considerations
We're planning to migrate a MySQL database with a mix utf8 and latin1 tables to the new utf8mb4 character set per this article: https://mathiasbynens.be/notes/mysql-utf8mb4.
Our server is 5.7.22 and ...
1
vote
1answer
17 views
Using CONVERT TO CHARACTER SET for changing only collation?
I think the answer to this is an obvious yes, but I'm having trouble finding confirmation on it. All the questions related to charsets seems to be about changing the charset and not only collations.
...
0
votes
0answers
39 views
Resolving “there is unknown charset/collation names” warnings on views
I recently moved our MySQL 5.6 server over to MariaDB 10.3.10 and, for the most part, have not had any problems. We have a couple of databases that have close to 1000 views which are now filling the ...
2
votes
2answers
246 views
How do I use 'N' in my prepared SELECT statement
I'm connecting to an SQL Server 2008 database using pdo and the ODBC Driver 13 for SQL Server.
I'm trying to run the following query which searches the database for Chinese characters:
SELECT TOP (...
6
votes
1answer
878 views
Error starting SQL Server 2017 service. Error Code 3417
I have SQL Server 2017 installed on my computer. This is what SELECT @@VERSION returns:
Microsoft SQL Server 2017 (RTM-GDR) (KB4293803) - 14.0.2002.14 (X64) Jul 21 2018 07:47:45 Copyright (C) ...
1
vote
2answers
210 views
Wrong sort order using utf8_unicode_ci and swedish characters like ö
I am confused about what encoding and collation I should use so my queries returns the correct sort order.
Right now my encoding is UTF-8 Unicode and collation utf8_unicode_ci for both firstname and ...
1
vote
1answer
33 views
Convert Character Encoding, and Check Encoding for Issues
I'm planning to convert a table from utf8 (_general_ci) to utf8mb4 (utf8mb4_unicode_ci). I want to make sure I don't have any malformed data after the conversion though so I was planning to duplicate ...
0
votes
1answer
150 views
Apostrophe shows up as “ÔÇÖ” [closed]
I pulled data out of a database and the apostrophe is showing up as "ÔÇÖ". What character set is this from?
1
vote
2answers
204 views
MySQL does not read user specific options in ~/.my.cnf
I want the server to run an initial SQL query every time it starts:
[mysqld]
init-connect='SET NAMES utf8mb4'
and I want it to be only user specific not globally. so I created a .my.cnf in my user's ...
0
votes
0answers
33 views
How to compile an Informix GLS Character Set. (.lc file into .lco to make an informix locale for databases)
Overview:
I am trying to make my own GLS locale/character set. I am doing this to add it to the locales in my informix instance under GLS/lc11/en_us/myfile.lco so that I can set my database/db ...
0
votes
1answer
177 views
Using character set en_us.364 in Informix database DB_LOCALE
I am trying to change my db_locale to en_us.364 which is an ASCII character set. It says on IBM's Knowledge Center that 364 is a valid character set:
https://www.ibm.com/support/knowledgecenter/en/...
1
vote
0answers
155 views
Converting and/or enforcing an Ascii Character Set in Informix database from 819 or ISO Latin 1
Overview: In Informix is it possible to enforce ASCII for a database or instance.
Details: I am trying to enforce ASCII in an instance of informix for a while. This is to help have a smooth ...
0
votes
2answers
638 views
How to fix accented character substitutions on French text in MySQL db
I'm building a small database for a charity I volunteer with. It will track events in English and French. When I enter characters like an accented e (as in "journée") it appears in the database as (...
0
votes
1answer
873 views
convert default charset utf8 tables to utf8mb4 mysql 5.7.17
I tried the following steps to upgrade CHARSET to utf8mb4 and to connect it to the existing backend server.
ALTER TABLE users CONVERT TO CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci;
update the ...
1
vote
0answers
276 views
Oracle Character Set/Database 11 to 12 Migration Options
Topic/Questions: Oracle Character Set/Database 11 to 12 Migration Options
Task:
Migrating production Oracle EE 11.2.0.4 single instance database with NLS_CHARACTERSET WE8ISO8859P1 to existing remote ...
1
vote
1answer
696 views
Issue with Hebrew characters in mysql
Lately i have migrated some schemas from mysql 4 to mysql 5.6. Everything works fine except one issue: Hebrew characters appears in Gibberish.
Here is the current configuration:
SHOW VARIABLES LIKE '...
4
votes
1answer
974 views
How do I list all available encoding types available in postgreSQL?
SELECT datname, pg_encoding_to_char(encoding)
FROM pg_database;
…lists all the databases, each with its encoding type.
However, I am trying to find out what are all the encoding types available in ...
1
vote
2answers
5k views
How do I set MySQL's “character_set_server” and “collation_server” variables when creating a database?
I'm using MySQL 5.5.37. How do I set the default "" and "" variables of my database when initially creating my db? I'm logged in as the root user but my command is not cutting it, as you can see ...
1
vote
1answer
387 views
German umlaute represented by questionmarks when latin1 is used
I'm almost certain this has come up before but I couldn't find anything regarding it.
My problem is that I've a database and a database server (and every table and column inside) set to latin1/...
1
vote
0answers
210 views
Loading MySQL Dump From one Character Set to Another
As you can see from these configuration differences, the MySQL server is configured with latin1, while the MariaDB server is using utf8mb4:
Variable MySQL Server MariaDB Server
...
1
vote
1answer
2k views
Converting character sets and foreign key constaints
I'm trying to convert the character set and collation of my MySQL database and all containing tables from utf8/utf8_unicode_ci to utf8mb4/utf8mb4_unicode_ci.
I will refer to my database name as: MyDB
...
3
votes
1answer
153 views
Error during CSSCAN of Oracle11 database
I have an issue when trying to change the character set on an Oracle 11.2 database.
Here are the particulars:
Oracle 11.2 64 bit, running under Oracle Linux 7
This is a new installation (i.e. the ...
3
votes
1answer
2k views
Collations and codesets in PostgreSQL 9.x
In Windows 7, the collation is set to "English_United States.1252" when I select the "English, United States" locale in the installer. In Linux, the collation is set to "en_US.UTF-8" by default.
I ...
1
vote
1answer
1k views
Character set query in Oracle12c
I have created my Oracle 12c database with database character set as AL32UTF8 and I have been told by the developers that it needs to be changed to UTF8.
National character set is UTF8.
Is it ...
1
vote
1answer
749 views
How do MariaDB and MySQL differ in character set handling?
In MySQL/MariaDB, I set the connection character set to UTF-8:
SET NAMES 'utf8mb4';
SET CHARACTER SET 'utf8mb4';
There are some tables with a latin1_swedish_ci collation and latin1 encoded data in ...
1
vote
2answers
3k views
CMD prompt can't display Unicode characters that are stored in oracle database correctly
I've been meddling with charset/encoding problems of Oracle database, PL/SQL developer and JDBC and these are what I want to achieve:
Input Unicode characters from a browser into the database
Display ...
2
votes
2answers
2k views
UTF8 Trouble while migrating from MSSQL to MySQL with MySQL Workbench
I am tasked with migrating part of our database from an on-site MSSQL server to an Amazon RDS MySQL. This will be my first attempt with a database migration, so I am doing a dry run from our MSSQL ...
0
votes
1answer
1k views
Stored Procedure Is Slower Than Query Due to Collation
I'm running two servers with MySql installed. I'm having an issue with a slow stored procedure (approximately 3 secs vs 0.1 seconds), solely on my production server, that is very quick on development ...
1
vote
3answers
1k views
character set, not set correctly
I have two database with a table with utf8 table, I wanted to change the encoding of a column, I used two scenarios but a problem happened to me.
at first the table was like this :
CREATE TABLE `...
2
votes
1answer
3k views
ERROR 1071 (42000): Specified key was too long; max key length is 767 bytes
I have a databases with latin1 charachter set, I need to change tables character set to utf8, but I get error. the current character set is :
mysql> show variables like "%character%";
+-----------...
1
vote
1answer
1k views
How large space will be occupied by mysql for a varchar utf8 column?
Tip: To save space with UTF-8, use VARCHAR instead of CHAR. Otherwise, MySQL must reserve three bytes for each character in a CHAR CHARACTER SET utf8 column because that is the maximum possible length....
0
votes
1answer
668 views
What are the side effects of changing MySQL `character_set_server`?
I am having some strange issues with character sets on my system. After digging through all kinds of settings, I found a discrepancy in my character set settings.
When I run show variables like '...
0
votes
2answers
73 views
Convert all the data of table (which have both encoding data) into single encoding either utf8 or latin1 [closed]
We have table which consists of two different encoding data (utf8 and latin1) which has been inserted from two different use cases of application. We are getting broken strings issue for other ...
0
votes
1answer
123 views
howto choose the right character set in MariaDB
if there are multiple character sets that can properly encode my data, how to choose one?
Is there any difference in disk or memory usage?
When joining tables do they need the same char set?
Other ...
1
vote
2answers
11k views
Oracle DB export, possible charset conversion if NLS_LANG not set
I need to export an Oracle database from one server and import it on another server. But I am getting the following information message at the beginning:
Connected to: Oracle Database 10g Release ...
1
vote
1answer
1k views
Cannot set character_set_database and character_set_server to utf8mb4
I'm trying to convert my MySQL server and its already existing schemas to the utf8mb4 character set.
Preliminary Notes:
I'm using Xampp (with MySQL 5.6.24). Default options are read from the ...
1
vote
2answers
385 views
Which accented characters are considered the same?
In MySQL, certain characters are considered the same when performing searches, e.g. 'n' and 'ñ'; unless you specify BINARY in the condition.
Is there a list somewhere of the characters that are ...
1
vote
0answers
872 views
Properly configuring Oracle Charset and NLS parameters
I'm trying to figure out the reason why Oracle SQL Developer shows question marks/rubbish on non-latin symbols. Currently I have 2 DBs on separate severs/instances, one of which works fine, and the ...
3
votes
2answers
1k views
Are there any known problems caused by having NLS_LENGTH_SEMANTICS set to CHAR on an Oracle database?
I've always thought that anyone using a database where NLS_LENGTH_SEMANTICS set to BYTE when using a multi-byte character set needed their heads examined, but recently a customer of ours said that ...
2
votes
1answer
13k views
How to disable case sensitivity in SQL Server 2012?
I tried to update collation_name in sys.databases. I am trying to change 'SQL_Latin1_General_CP1_CS_AS' to 'SQL_Latin1_General_CP1_CI_AS' in order to disable case sensitivity in table.
update d set d....
0
votes
1answer
83 views
Trying to support unicode in MySQL database
I am doing a project in which I have to save tweets into my MySQL database. The problem is some tweets contains smilies and other symbols which I am not able to save - it shows error like below:
...
0
votes
2answers
984 views
Handling lossy data before character- set migration
I am trying to migrate a database from US7ASCII to AL32UTF8 using CSSCAN. During the initial scanning using CSSCAN we have found the presence of lossy data both in data dictionary() and application ...
1
vote
0answers
352 views
Unicode character replication MSSQL to MYSQL in Symmetric DS
I'm doing replication from MSSQL to MYSQL using symmetricds and it is working fine.
Now , the problem is:
In the SQL Server table , I have a column defined as NVARCHAR(20) which accepts unicode ...
2
votes
2answers
2k views
Removing per column and table collation and charset
I recently completed a transition of a database from CHARSET=utf8 COLLATE=latin1 to CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci. During the process tables were migrated one at a time by altering their ...
0
votes
0answers
82 views
Database Importing Collation
Migrating from DB2 found this error message:
Error message: Incorrect string value: '\xF2\xAC\x9F\xB0or...' for column 'column_name'
This is when trying to import an XML to MySQL. I should have a ...
0
votes
1answer
180 views
How to determine character encoding in Hyper SQL database
I have Hyper SQL database and I don't know what is current character set. Is it set for whole DB or it can be different for every table? How to evaluate encoding in my base?
1
vote
1answer
69 views
Extract all unique chars from all texts across the table
I have a huge mysql table (20 columns by 320.000 rows) that contains a lot of text from a lot of languages and the problem is that I need to identify all the unique characters in that table. For ...
0
votes
1answer
809 views
Gotchas converting latin1_swedish_ci to utf8mb4_unicode_ci
I have a MySQL 5.5.31 database which has approx 220 tables - of these 220 tables, around half of them are already using utf8mb4_unicode_ci but the "older" tables are still using latin1_swedish_ci. The ...
0
votes
0answers
118 views
Slave executing queries with different charset
I need to change a database charset because of this issue and I solved my issue in staging environment with the SQL command
ALTER TABLE `articles` CONVERT TO CHARACTER SET utf8 COLLATE ...
2
votes
2answers
8k views
MySQL silently replaces UTF chars with literal question marks
I'm experiencing a situation similar to this SO question i.e. I'm working with a legacy database which has UTF8 content in latin1 tables (pretty ugly I know).
Now I'm getting new data from a new ...
