The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
0answers
11 views

Special characters encoding data flow SAP Data Services

I have been struggling with the configuration of a new oracle datastore, my problem is related with encoding : I have added my database definition to tnsnames.ora file on the job server (redhat ...
0
votes
0answers
11 views

Firebird 2.5 - difference between starting with and = (equal) string searches

Background I have DB that was created on Windows, FB 2.5.0 (long ago). It was subsequently upgraded, over the years, to 2.5.4. Yesterday I wanted to test it on Ubuntu, which has FB 2.5.2 maintained ...
0
votes
1answer
1k views

How to convert a MySQL database from utf8mb4 to utf8?

I would like to convert a MySQL database, which has utf8mb4 character set and utf8mb4_unicode_ci collation, to utf8 and utf8_unicode_ci. How to do that please? Thank you in advance for your ...
9
votes
2answers
32k views

SQL Server 2005/2008 UTF-8 Collation/Charset

I can't find option(s) directly to set UTF-8 rellated Collations/Charsets in SQL Server 2005/2008, same as is possible to set in another SQL engines, but in SQL Server 2005/2008 are there only Latin ...
0
votes
1answer
25 views

Handling lossy data before character- set migration

I am trying to migrate a database from US7ASCII to AL32UTF8 using CSSCAN. During the initial scanning using CSSCAN we have found the presence of lossy data both in data dictionary() and application ...
4
votes
1answer
12k views

Why default character_set_server is latin1?

I am using MySQL 5.5 and when I show variables about charset, I have +--------------------------+----------------------------+ | Variable_name | Value | ...
2
votes
1answer
184 views

Dump with special characters in table column name

I'm taking over an old database, and while doing recovery tests from my dump I found out a table is wrongly backed up, the table definition is truncated. Looking at the live db I've found a column ...
1
vote
1answer
206 views

Remove question marks from database(latin1_general_ci table)?

How can I remove question marks(not diamond shaped) from a latin1_general_ci MyISAM table? I tried going back to utf8 and tried to apply things in ...
0
votes
0answers
30 views

nbsp character might not be passing as nbsp to the MySQL backend

I am following a tutorial where a web application written in PHP, blacklists spaces from the input(The 'id' parameter). The task is to add other characters, which essentially bypasses this blacklist, ...
2
votes
2answers
2k views

ORA-12899: importing a .dmp file + character set conversion

I'm working on a django project on Ubuntu 10.04 with Oracle Database Server , so I've installed: Oracle Database 10g xe universal Rel.10.2.0.1.0 cx_Oracle-5.0.4-10g-unicode-py26-1.x86_64 When I ...
3
votes
0answers
198 views

utf8mb4 in SQL Server Express

We have some web applications based on databases using utf8mb4 as character set and utf8mb4_Standard as collation. We saw that we can use any character we want with this setting. In SQL Server ...
0
votes
1answer
52 views

Removing per column and table collation and charset

I recently completed a transition of a database from CHARSET=utf8 COLLATE=latin1 to CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci. During the process tables were migrated one at a time by altering their ...
0
votes
2answers
1k views

unable to insert utf8mb4 characters in mysql 5.6

recently i was facing problem in inserting emoji and other 4 bytes character in my mysql database then i found that my mysql version was 5.1 and it does not support utf8mb4 so i upgraded to mysql 5.6 ...
0
votes
0answers
27 views

Database Importing Collation

Migrating from DB2 found this error message: Error message: Incorrect string value: '\xF2\xAC\x9F\xB0or...' for column 'column_name' This is when trying to import an XML to MySQL. I should have a ...
0
votes
0answers
11 views

How to determine character encoding in Hyper SQL database

I have Hyper SQL database and I don't know what is current character set. Is it set for whole DB or it can be different for every table? How to evaluate encoding in my base?
0
votes
1answer
83 views

Gotchas converting latin1_swedish_ci to utf8mb4_unicode_ci

I have a MySQL 5.5.31 database which has approx 220 tables - of these 220 tables, around half of them are already using utf8mb4_unicode_ci but the "older" tables are still using latin1_swedish_ci. The ...
1
vote
1answer
21 views

extract all unique chars from all texts across the table

I have a huge mysql table (20 columms by 320.000 rows) that contains a lot of text from a lot of languages and the problem is that I need to identify all the unique characters in that table. For ...
0
votes
0answers
40 views

Slave executing queries with different charset

I need to change a database charset because of this issue and I solved my issue in staging environment with the SQL command ALTER TABLE `articles` CONVERT TO CHARACTER SET utf8 COLLATE ...
1
vote
2answers
389 views

MySQL silently replaces UTF chars with literal question marks

I'm experiencing a situation similar to this SO question i.e. I'm working with a legacy database which has UTF8 content in latin1 tables (pretty ugly I know). Now I'm getting new data from a new ...
0
votes
0answers
242 views

SAP IQ 16.0: Load table encoding/charset

I try to load table from a txt file to Sybase IQ Server using LOAD TABLE statement. And I had encoding trouble getting inserted records like this ћРР РђРЎРўРќРћ. And I solved my problem using set ...
0
votes
0answers
44 views

Ascii Symbols are Shown In varchar and Datetime Column Values of Mysql

Some rows in my database are shown in binary format. DateTime values are shown as below in Sqlyog. DC1203-68-58 51:18:72 Æ420-94-57 38:13:76 \722-49-30 63:17:35 ETB801-61-42 37:69:60 When i ...
1
vote
2answers
2k views

SQL Server to MySQL migration - how can I remove UCS-2 surrogate pairs in SQL Server?

I have been tasked with migrating a SQL Server 2005 database to MySQL 5.6 (these are both database servers runnig locally) and would really appreciate some help. -------Edit - Answered------- This ...
1
vote
1answer
45 views

How to determine column character set used on creation?

I have this SQL creation statement: CREATE TABLE `testdb`.`new_table` ( `id` INT NOT NULL AUTO_INCREMENT, `text_default` VARCHAR(45) NULL, `text_latin` VARCHAR(45) CHARACTER SET 'latin1' ...
2
votes
1answer
832 views

DBD::mysql complains “Character set 'latin1' is not a compiled character set”

I think this boils down to "Am I doomed to upgrading mysql hoping the problem goes away?". I've seen a few of the same issues around the internet but with no guidance on a fix other than "Did you turn ...
2
votes
2answers
599 views

How to convert html entities in Oracle?

I'm trying to decode html containing html entities. I've tried dbms_xmlgen.convert and utl_i18n.unescape_reference but the results are less than satisfactory. SET ESCAPE ON; SELECT ...
2
votes
1answer
85 views

False positive error message in MS Access (concurrent users)

I have discovered a strange apparent bug in MS Access and would like to know if others know it already and hopefully how to get around it. Trying to count records based on known column categories. ...
0
votes
0answers
43 views

Cant login to DataBase migration assistant in oracle 12c while i can easily connect in sqlplus

I need to change the character set of my database( I have no idea how it got created with that character set in first place! would be nice to know as well). I searched and found out that i need to use ...
0
votes
1answer
1k views

MySQL Workbench run SQL script file Character Set encoding issue

Upon running a .sql file for creating a schema in MySQL Workbench 6.1, it prompts a window saying it cannot decide the right character set What's the proper thing to do?
0
votes
1answer
12 views

Completely disable all support for a certain CHAR SET in MySQL?

Is it possible to completely disallow certain charsets in MySQL and force an error and/or force everything into the server's chosen default charset?
0
votes
1answer
84 views

change character set in mysql permanently

I want to change following parameters to utf8mb4 so that mysql can store emoji characters and special language characters. but when i try running following statements one by one SET ...
0
votes
1answer
76 views

Want to create partitions of a MySQL table and change the charset of new partitions

I have a database table which contains large amount of data. I have written a script to create new partitions every week and drop old partitions (which are of no use). Currently, I have a column in ...
1
vote
1answer
222 views

MySQLSyntaxErrorException on ALTER TABLE … CONVERT TO … in MySQL Connector/J

Running Ubuntu 14.04 with mysql-connector-java-5.1.28 installed. Let's create a table: CREATE TABLE mytable (value1 VARCHAR(32000), value2 TEXT, value3 VARCHAR(1000), value4 VARCHAR(32000)) ...
0
votes
1answer
1k views

Netezza LIKE operator not finding subsequent backslashes

Netezza is able to find records when using the LIKE operator when the first character contains a backslash character. But when subsequent characters contain a backslash character, it cannot. How can ...
2
votes
2answers
4k views

Encoding problems with sqlplus, Linux

I use sqlplus and all non-Latin characters appear as '?' when I run select queries. When I run insert or update queries with non-Latin characters I get question marks on a web page. select * from ...
1
vote
3answers
2k views

Inserting Serbian Latin and Cyrillic characters

I am using SQL Server 2012 Express as part of my asp.net development workstation. Database and table collation is set to Latin1_General_CI_AI. Attribute types are nvarchar(max) and varchar(max). ...
1
vote
0answers
234 views

Master and slave tables with different character sets - will replication break?

We have some huge tables in our MySQL 5.6 database that have latin-1 as their character set, and want to convert them all to UTF-8 (along with converting the database's global character set). The ...
0
votes
2answers
121 views

Table size reduce with help changing collation charset [MySQL]

I have table which is big enough, phpmyadmin shows that it takes more than 40Gb space. I can't remove data from it, but I've figure out one thing: there is one field which is described as ...
1
vote
2answers
3k views

Postgres client unable to detect UTF-8 database

Context I am deploying a Vagrant box for my development team, and have encountered a problem restoring UTF-8 collated dumps. I don't believe it is related to the now-infamous "UTF8" has no equivalent ...
1
vote
2answers
1k views

Setting default CHARSET and DB Engine

I recently updated my server's database system from MySQL to MariaDB. After update, everything works well. But, when I went to phpMyAdmin, the default charset and types are changed: At the end of ...
0
votes
1answer
979 views

Oracle Character set identification

In the given export(Normal Export) log file i see following: Export done in WE8ISO8859P1 character set and AL16UTF16 NCHAR character set Is this multi-byte or single byte database char-set. Can you ...
0
votes
1answer
135 views

Which string variables in mysql support utf-8?

I have a table that stores string from a user and is displayed in a web form. But as I see when the user inputs e.g. in a language of cyrilic alphabet (I assume is UTF-8) garbage are displayed back. I ...
1
vote
0answers
19 views

Recover original utf8 data from latin1 mysql db [duplicate]

We forgot to change charsets in our mysql db after migration on new server. Current situation: mysql> show variables like 'character%'; +--------------------------+----------------------------+ | ...
2
votes
3answers
1k views

Why are there different levels of MySQL collation/charsets?

Looking at the MySQL server variables the server and database collation are set to latin1_swedish_ci but the collaction_connection is utf8_general_ci. Additionally, the collation/charset is set at ...
1
vote
0answers
506 views

How do I convert unicode data from UTF-16LE to UTF-8 when migrating from SQL Server to MySQL?

Objective: Ensure existing Unicode (UTF-16LE) data is displayed the when moved to MySQL (UTF-8). Background: I'm migrating 1TB from SQL Server to MySQL. The current Collation in SS is ...
1
vote
0answers
48 views

What is the smallest encoding?

I am now using latin1 (CHAR 10 column type) and I was wondering if there is more efficient character-set to store password hash consisting of a-z0-9 characters.
1
vote
1answer
1k views

Solutions to 4-byte utf-8 characters in mysql 5.1

I'm running into a problem that seems to be an issue w/ mysql 5.1s limitations on UTF8 characters. From http://dev.mysql.com/doc/refman/5.1/en/charset-unicode-utf8.html Currently, MySQL support for ...
4
votes
1answer
4k views

Do I need to use NVARCHAR rather than VARCHAR to properly store UTF8 characters in Oracle?

I want my Oracle database to properly store ALL possible UTF8 characters. If NLS_CHARSET is set to AL32UTF8 is that all I need to do? Or do I need to also make sure I use NCHAR and NVARCHAR rather ...
1
vote
2answers
919 views

How do I find an invalid utf8 character “somewhere” in my MySQL/trac database

I have an installation of trac, which uses MySQL. It has been upgraded so many times, moved servers etc. and chances are that the MySQL character sets were not always set correctly or consistently ...
0
votes
1answer
446 views

MySQL not allowing text columns?

I'm using MySQL 5.5.27. I currently have a BLOB column, that I want to convert to text to allow fulltext searching. The ALTER TABLE command to create a text column is successful, but the ALTER TABLE ...
2
votes
2answers
4k views

Modify all tables in a database with a single command

Is there a single or a one line command to modify all tables within a database. I would like to issue this command in every table within a database: ALTER TABLE `table_name` CONVERT TO CHARACTER SET ...