The tag has no wiki summary.

learn more… | top users | synonyms

9
votes
1answer
30k views

SQL Server 2005/2008 UTF-8 Collation/Charset

I can't find option(s) directly to set UTF-8 rellated Collations/Charsets in SQL Server 2005/2008, same as is possible to set in another SQL engines, but in SQL Server 2005/2008 are there only Latin ...
7
votes
2answers
6k views

How to convert control characters in MySQL from latin1 to UTF-8?

While converting a database to UTF-8 I noticed a strange behavior regarding the control characters 0x80-0x9F. For example, 0x92 (right apostrophe) would not get converted to UTF-8 and truncate the ...
5
votes
3answers
1k views

Querying special characters

I work with language with special characters (example: e -> é). I have a query with a LIKE but when I search a word with special char and my query doesn't have the special char, I don't get the ...
4
votes
1answer
4k views

Do I need to use NVARCHAR rather than VARCHAR to properly store UTF8 characters in Oracle?

I want my Oracle database to properly store ALL possible UTF8 characters. If NLS_CHARSET is set to AL32UTF8 is that all I need to do? Or do I need to also make sure I use NCHAR and NVARCHAR rather ...
4
votes
2answers
22k views

Determine Oracle session client character set?

I know how the database characterset (NLS_CHARACTERSET in select * from v$nls_parameters;) and the client character set (the client environment setting NLS_LANG) interact. What I can't find out ...
4
votes
2answers
838 views

MySQL - Changing DB CHARACTER SET

I have a 30GB MySql DB, made of innoDB tables. currently the tables character set is: "utf8_unicode_ci" and I want to change it to "utf8_general_ci", what the best way to do it? currently i'm going ...
4
votes
1answer
11k views

Why default character_set_server is latin1?

I am using MySQL 5.5 and when I show variables about charset, I have +--------------------------+----------------------------+ | Variable_name | Value | ...
3
votes
1answer
3k views

What does WE8DEC mean?

It is one of the commonly used character sets. What does it stand for? Is it an acronym for something?
3
votes
2answers
2k views

Character Set Database Migration

This is a follow-up question to a previous thread I had posted. We're in the process of migrating to a new character set. Now, I am a programmer and we have DBA's who will be performing the work but ...
3
votes
1answer
5k views

How can I insert smiley faces into MySQL ( 😊 )

I'm on MySQL 5.5.21, and trying to insert the '\xF0\x9F\x98\x8A' smiley face character. But for the life of me, I can't figure out how to do it. According to various forums which I've been reading, ...
3
votes
2answers
499 views

Character Set Encoding in a Table

I have the following data:Trollhättan If I print out and setting up the header to utf-8, then this is the output in the browser. If I'm not setting up the utf-8 in the header, Trollhättan. ...
3
votes
0answers
179 views

utf8mb4 in SQL Server Express

We have some web applications based on databases using utf8mb4 as character set and utf8mb4_Standard as collation. We saw that we can use any character we want with this setting. In SQL Server ...
2
votes
2answers
1k views

SQL Server imports data in wrong charset with SSIS

I have a flat file which I am importing into a SQL Server table using a SSIS package. The code page is set to 65001. However, when I run a SELECT * FROM tableName the data appears mangled. For ...
2
votes
2answers
2k views

Is there any doc listing standard <=> Oracle character sets correspondencies?

I'm looking for a table listing Oracle and "standard" character sets, for example: Oracle Standard ------------ ---------- WEISO98859P1 iso-8859-1 AL32UTF8 utf-8 etc. etc. Does ...
2
votes
2answers
517 views

How to convert html entities in Oracle?

I'm trying to decode html containing html entities. I've tried dbms_xmlgen.convert and utl_i18n.unescape_reference but the results are less than satisfactory. SET ESCAPE ON; SELECT ...
2
votes
2answers
7k views

Tell MySQL to start using utf-8 encoding without `convert to`ing it

In a fairly unique situation, my team has ended up with UTF-8 bytes in a database that thinks the data is encoded as latin1. At least, I'm 85% certain that this is the situation at hand. For ...
2
votes
1answer
608 views

Oracle 10 to 11: charset issue

I was redirected from SE's root site to this one. I'm not a DBA, so I shouldn't be doing this, but I have to, so I apologize beforehand to all of you DBAs that will read this post: I'm migrating an ...
2
votes
2answers
2k views

ORA-12899: importing a .dmp file + character set conversion

I'm working on a django project on Ubuntu 10.04 with Oracle Database Server , so I've installed: Oracle Database 10g xe universal Rel.10.2.0.1.0 cx_Oracle-5.0.4-10g-unicode-py26-1.x86_64 When I ...
2
votes
1answer
537 views

Correcting the imported latin1 data to be utf8

I restored my drupal site database from a backup but after i finished i discovered that the Imported data was symbols like this قوانين كرة because the backup was taken using latin1 charset ...
2
votes
1answer
1k views

“Data truncated” vs “Incorrect string value”

I'm trying to figure out the difference between some warning messages related to data truncation. Consider the following table: CREATE TABLE `txttest` ( `mycol` text NOT NULL ) ...
2
votes
1answer
3k views

What's the differences between utf8_general_ci and utf8_unicode_ci and utf8_binary collation in MySQL?

I'm can't find the documentation of MySQL on this topic. Anyone can give some explanations please?
2
votes
1answer
789 views

DBD::mysql complains “Character set 'latin1' is not a compiled character set”

I think this boils down to "Am I doomed to upgrading mysql hoping the problem goes away?". I've seen a few of the same issues around the internet but with no guidance on a fix other than "Did you turn ...
2
votes
1answer
83 views

False positive error message in MS Access (concurrent users)

I have discovered a strange apparent bug in MS Access and would like to know if others know it already and hopefully how to get around it. Trying to count records based on known column categories. ...
2
votes
3answers
1k views

Why are there different levels of MySQL collation/charsets?

Looking at the MySQL server variables the server and database collation are set to latin1_swedish_ci but the collaction_connection is utf8_general_ci. Additionally, the collation/charset is set at ...
2
votes
2answers
4k views

Encoding problems with sqlplus, Linux

I use sqlplus and all non-Latin characters appear as '?' when I run select queries. When I run insert or update queries with non-Latin characters I get question marks on a web page. select * from ...
1
vote
3answers
2k views

Inserting Serbian Latin and Cyrillic characters

I am using SQL Server 2012 Express as part of my asp.net development workstation. Database and table collation is set to Latin1_General_CI_AI. Attribute types are nvarchar(max) and varchar(max). ...
1
vote
2answers
2k views

SQL Server to MySQL migration - how can I remove UCS-2 surrogate pairs in SQL Server?

I have been tasked with migrating a SQL Server 2005 database to MySQL 5.6 (these are both database servers runnig locally) and would really appreciate some help. -------Edit - Answered------- This ...
1
vote
1answer
6k views

€ Euro sign/symbol not showing up on Oracle 10gr2 and aix 6.1

this is Oracle 10gr2 on aix 6100-02 The issue is that I do not manage to see the € sign from Oracle. This is an easy way to see the issue: SQL> insert into prueba values ('€'); SQL> commit; ...
1
vote
1answer
2k views

MySql command line cyrillic Iinsert result is corrupted

Have putty connection. Putty config : window-->translation-->remote character set-->utf-8 Launch command line MySQL client. Perform insert with cyrillic like: CREATE TABLE `category` ( `catName` ...
1
vote
2answers
896 views

How do I find an invalid utf8 character “somewhere” in my MySQL/trac database

I have an installation of trac, which uses MySQL. It has been upgraded so many times, moved servers etc. and chances are that the MySQL character sets were not always set correctly or consistently ...
1
vote
2answers
234 views

MySQL silently replaces UTF chars with literal question marks

I'm experiencing a situation similar to this SO question i.e. I'm working with a legacy database which has UTF8 content in latin1 tables (pretty ugly I know). Now I'm getting new data from a new ...
1
vote
2answers
3k views

Postgres client unable to detect UTF-8 database

Context I am deploying a Vagrant box for my development team, and have encountered a problem restoring UTF-8 collated dumps. I don't believe it is related to the now-infamous "UTF8" has no equivalent ...
1
vote
1answer
1k views

Solutions to 4-byte utf-8 characters in mysql 5.1

I'm running into a problem that seems to be an issue w/ mysql 5.1s limitations on UTF8 characters. From http://dev.mysql.com/doc/refman/5.1/en/charset-unicode-utf8.html Currently, MySQL support for ...
1
vote
1answer
21 views

extract all unique chars from all texts across the table

I have a huge mysql table (20 columms by 320.000 rows) that contains a lot of text from a lot of languages and the problem is that I need to identify all the unique characters in that table. For ...
1
vote
1answer
45 views

How to determine column character set used on creation?

I have this SQL creation statement: CREATE TABLE `testdb`.`new_table` ( `id` INT NOT NULL AUTO_INCREMENT, `text_default` VARCHAR(45) NULL, `text_latin` VARCHAR(45) CHARACTER SET 'latin1' ...
1
vote
1answer
188 views

Remove question marks from database(latin1_general_ci table)?

How can I remove question marks(not diamond shaped) from a latin1_general_ci MyISAM table? I tried going back to utf8 and tried to apply things in ...
1
vote
2answers
3k views

Modify all tables in a database with a single command

Is there a single or a one line command to modify all tables within a database. I would like to issue this command in every table within a database: ALTER TABLE `table_name` CONVERT TO CHARACTER SET ...
1
vote
1answer
432 views

MySQL Character set and Collation Issue.?

I Have a table when i select from the table i got the invalid data as mysql> select budgetID,StartDate,modifiedBy from Table_name order by budgetID desc limit 10; ...
1
vote
1answer
2k views

MySQL transfer ISO-8859-1 to UTF-8

How to transfer data from Database with latin1 character set, to database UTF-8. And on transferring convert data from latin1 to UTF-8 e.g., û->ū, ë->ė, þ->ž, á->į and etc.
1
vote
1answer
207 views

MySQLSyntaxErrorException on ALTER TABLE … CONVERT TO … in MySQL Connector/J

Running Ubuntu 14.04 with mysql-connector-java-5.1.28 installed. Let's create a table: CREATE TABLE mytable (value1 VARCHAR(32000), value2 TEXT, value3 VARCHAR(1000), value4 VARCHAR(32000)) ...
1
vote
0answers
219 views

Master and slave tables with different character sets - will replication break?

We have some huge tables in our MySQL 5.6 database that have latin-1 as their character set, and want to convert them all to UTF-8 (along with converting the database's global character set). The ...
1
vote
2answers
1k views

Setting default CHARSET and DB Engine

I recently updated my server's database system from MySQL to MariaDB. After update, everything works well. But, when I went to phpMyAdmin, the default charset and types are changed: At the end of ...
1
vote
0answers
19 views

Recover original utf8 data from latin1 mysql db [duplicate]

We forgot to change charsets in our mysql db after migration on new server. Current situation: mysql> show variables like 'character%'; +--------------------------+----------------------------+ | ...
1
vote
0answers
495 views

How do I convert unicode data from UTF-16LE to UTF-8 when migrating from SQL Server to MySQL?

Objective: Ensure existing Unicode (UTF-16LE) data is displayed the when moved to MySQL (UTF-8). Background: I'm migrating 1TB from SQL Server to MySQL. The current Collation in SS is ...
1
vote
0answers
48 views

What is the smallest encoding?

I am now using latin1 (CHAR 10 column type) and I was wondering if there is more efficient character-set to store password hash consisting of a-z0-9 characters.
0
votes
2answers
113 views

Table size reduce with help changing collation charset [MySQL]

I have table which is big enough, phpmyadmin shows that it takes more than 40Gb space. I can't remove data from it, but I've figure out one thing: there is one field which is described as ...
0
votes
1answer
665 views

MYSQL dump and problems character encoding

I have a 2 gb old database sql backup file. The problem is that text is encoded in UTF-8. Actually this isnt the real problem. This database contains greek and english characters. The problem is ...
0
votes
1answer
68 views

Gotchas converting latin1_swedish_ci to utf8mb4_unicode_ci

I have a MySQL 5.5.31 database which has approx 220 tables - of these 220 tables, around half of them are already using utf8mb4_unicode_ci but the "older" tables are still using latin1_swedish_ci. The ...
0
votes
2answers
1k views

unable to insert utf8mb4 characters in mysql 5.6

recently i was facing problem in inserting emoji and other 4 bytes character in my mysql database then i found that my mysql version was 5.1 and it does not support utf8mb4 so i upgraded to mysql 5.6 ...
0
votes
1answer
1k views

MySQL Workbench run SQL script file Character Set encoding issue

Upon running a .sql file for creating a schema in MySQL Workbench 6.1, it prompts a window saying it cannot decide the right character set What's the proper thing to do?