We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [character-set]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
2answers
48 views

charindex thrown off by extended characters

I've got a column with a filenames stored in a nvarchar(255). I'm trying to parse out the file extension using reverse( left( reverse(filename), charindex('.', reverse(filename) ) -1 ) ) This works ...
12
votes
1answer
3k views

Error starting SQL Server 2017 service. Error Code 3417

I have SQL Server 2017 installed on my computer. This is what SELECT @@VERSION returns: Microsoft SQL Server 2017 (RTM-GDR) (KB4293803) - 14.0.2002.14 (X64) Jul 21 2018 07:47:45 Copyright (C) ...
1
vote
1answer
198 views

Error during CSSCAN of Oracle11 database

I have an issue when trying to change the character set on an Oracle 11.2 database. Here are the particulars: Oracle 11.2 64 bit, running under Oracle Linux 7 This is a new installation (i.e. the ...
5
votes
1answer
82 views

Query to find rows containing ASCII characters in a given range

I am using some scripts from another topic, but the accepted answer isn't working for all my data scenarios. I would have asked my question on the original How to check for Non-Ascii Characters post, ...
2
votes
2answers
145 views

Using CONVERT TO CHARACTER SET for changing only collation?

I think the answer to this is an obvious yes, but I'm having trouble finding confirmation on it. All the questions related to charsets seems to be about changing the charset and not only collations. ...
0
votes
2answers
48 views

Which characters are considered “word” characters

Fulltext searchin with InnoDB in MySQL only includes certain characters referred to in the docs as "word characters" and mentioned here: For the built-in full-text parser, you can change the set of ...
2
votes
2answers
25 views

How to bulk convert ISO8859 text in Text columns to UTF8 in nvarchar(max) columns?

I've been struggling for days with a problem on a MS SQL database. Here is the situation: I have an old Open Source PHP application (Limesurvey version 1.92) running on a Windows 2008R2 server, with ...
0
votes
1answer
237 views

Character set 'utf8mb4' is not a compiled character set and is not specified in the '/usr/share/mysql/charsets/Index.xml' file

Full error Character set 'utf8mb4' is not a compiled character set and is not specified in the '/usr/share/mysql/charsets/Index.xml' file InvalidArgumentException: There was a problem connecting to ...
1
vote
1answer
33 views

Is there a MySQL character set and encoding that will allow for both emojis and accents?

I've got a database of terms that get added to by one group of users, and queried against by another. I was running into problems when people would query for an emoji in the database and my React app ...
1
vote
1answer
879 views

What are the side effects of changing MySQL `character_set_server`?

I am having some strange issues with character sets on my system. After digging through all kinds of settings, I found a discrepancy in my character set settings. When I run show variables like '...
0
votes
1answer
2k views

change character set in mysql permanently

I want to change following parameters to utf8mb4 so that mysql can store emoji characters and special language characters. but when i try running following statements one by one SET ...
0
votes
1answer
89 views

Trying to support unicode in MySQL database

I am doing a project in which I have to save tweets into my MySQL database. The problem is some tweets contains smilies and other symbols which I am not able to save - it shows error like below: ...
2
votes
4answers
16k views

unable to insert utf8mb4 characters in mysql 5.6

recently i was facing problem in inserting emoji and other 4 bytes character in my mysql database then i found that my mysql version was 5.1 and it does not support utf8mb4 so i upgraded to mysql 5.6 ...
3
votes
2answers
991 views

Change default collation for character set utf8mb4 to utf8mb4_unicode_ci

When creating a database without specifying a character set or collation the servers defaults are used (as expected). MariaDB [(none)]> SHOW VARIABLES LIKE '%_server' ; +----------------------+----...
0
votes
1answer
32 views

Postgres special character rendering

I have an old Sql Server db with a ‘free entry’ field that is being accessed via a Postgres 10.6 foreign table. This field contains a lot of garbage characters (higher than Ascii 128) which Postgres ...
0
votes
1answer
48 views

MySQL: columns with mixed character encodings, and finding columns which have multibyte data

I have some rather large CSV files that I am loading into my MySQL 5.7 database. The files are several gigabytes in size, several million lines long, and have large column widths that must be used in ...
6
votes
2answers
2k views

What is the SQL Server equivalent of MySQL's utf8mb4 character set?

We have some web applications based on databases using utf8mb4 as character set and utf8mb4_Standard as collation. We saw that we can use any character we want with this setting. In SQL Server ...
17
votes
4answers
9k views

Why does the varchar datatype allow unicode values?

I have a table with a varchar column. It is allowing Trademark(™), copyright(©) and other Unicode characters as shown below. Create table VarcharUnicodeCheck ( col1 varchar(100) ) insert into ...
2
votes
2answers
37k views

How to convert a MySQL database from utf8mb4 to utf8?

I would like to convert a MySQL database, which has utf8mb4 character set and utf8mb4_unicode_cicollation, to utf8 and utf8_unicode_ci. How to do that please? Thank you in advance for your ...
1
vote
1answer
65 views

Why doesn't MySQL coerce the collation to the column-specified, when comparing to a literal?

I have a table with a collation defined on a column: CREATE TEMPORARY TABLE test_table ( utf8_col VARCHAR(255) CHARACTER SET utf8 COLLATE utf8_bin ); INSERT INTO test_table VALUES('ã'); According ...
-1
votes
1answer
683 views

Incorrect string value: '\xF0\x9F\xA4\x96<b…' for column 'body' at row 1 [closed]

I've set the column type to utf8mb4 and the collation to utf8mb4_bin. The table defaults are also utf8mb4 and utf8mb4_bin. When I use SequelPro to add the emoji "🤖" to the database manually, it ...
1
vote
1answer
73 views

MySQL utf8mb4 Migration - Replication Considerations

We're planning to migrate a MySQL database with a mix utf8 and latin1 tables to the new utf8mb4 character set per this article: https://mathiasbynens.be/notes/mysql-utf8mb4. Our server is 5.7.22 and ...
2
votes
2answers
3k views

Removing per column and table collation and charset

I recently completed a transition of a database from CHARSET=utf8 COLLATE=latin1 to CHARSET=utf8mb4 COLLATE=utf8mb4_unicode_ci. During the process tables were migrated one at a time by altering their ...
0
votes
0answers
164 views

Resolving “there is unknown charset/collation names” warnings on views

I recently moved our MySQL 5.6 server over to MariaDB 10.3.10 and, for the most part, have not had any problems. We have a couple of databases that have close to 1000 views which are now filling the ...
2
votes
2answers
512 views

How do I use 'N' in my prepared SELECT statement

I'm connecting to an SQL Server 2008 database using pdo and the ODBC Driver 13 for SQL Server. I'm trying to run the following query which searches the database for Chinese characters: SELECT TOP (...
1
vote
2answers
569 views

Wrong sort order using utf8_unicode_ci and swedish characters like ö

I am confused about what encoding and collation I should use so my queries returns the correct sort order. Right now my encoding is UTF-8 Unicode and collation utf8_unicode_ci for both firstname and ...
1
vote
1answer
1k views

Issue with Hebrew characters in mysql

Lately i have migrated some schemas from mysql 4 to mysql 5.6. Everything works fine except one issue: Hebrew characters appears in Gibberish. Here is the current configuration: SHOW VARIABLES LIKE '...
1
vote
1answer
52 views

Convert Character Encoding, and Check Encoding for Issues

I'm planning to convert a table from utf8 (_general_ci) to utf8mb4 (utf8mb4_unicode_ci). I want to make sure I don't have any malformed data after the conversion though so I was planning to duplicate ...
0
votes
1answer
276 views

Apostrophe shows up as “ÔÇÖ” [closed]

I pulled data out of a database and the apostrophe is showing up as "ÔÇÖ". What character set is this from?
1
vote
2answers
363 views

MySQL does not read user specific options in ~/.my.cnf

I want the server to run an initial SQL query every time it starts: [mysqld] init-connect='SET NAMES utf8mb4' and I want it to be only user specific not globally. so I created a .my.cnf in my user's ...
1
vote
0answers
210 views

Converting and/or enforcing an Ascii Character Set in Informix database from 819 or ISO Latin 1

Overview: In Informix is it possible to enforce ASCII for a database or instance. Details: I am trying to enforce ASCII in an instance of informix for a while. This is to help have a smooth ...
0
votes
1answer
293 views

Using character set en_us.364 in Informix database DB_LOCALE

I am trying to change my db_locale to en_us.364 which is an ASCII character set. It says on IBM's Knowledge Center that 364 is a valid character set: https://www.ibm.com/support/knowledgecenter/en/...
0
votes
2answers
2k views

How to fix accented character substitutions on French text in MySQL db

I'm building a small database for a charity I volunteer with. It will track events in English and French. When I enter characters like an accented e (as in "journée") it appears in the database as (...
1
vote
1answer
2k views

convert default charset utf8 tables to utf8mb4 mysql 5.7.17

I tried the following steps to upgrade CHARSET to utf8mb4 and to connect it to the existing backend server. ALTER TABLE users CONVERT TO CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci; update the ...
1
vote
1answer
2k views

Cannot set character_set_database and character_set_server to utf8mb4

I'm trying to convert my MySQL server and its already existing schemas to the utf8mb4 character set. Preliminary Notes: I'm using Xampp (with MySQL 5.6.24). Default options are read from the ...
5
votes
3answers
7k views

Is there any doc listing standard <=> Oracle character sets correspondencies?

I'm looking for a table listing Oracle and "standard" character sets, for example: Oracle Standard ------------ ---------- WEISO98859P1 iso-8859-1 AL32UTF8 utf-8 etc. etc. Does ...
1
vote
0answers
473 views

Oracle Character Set/Database 11 to 12 Migration Options

Topic/Questions: Oracle Character Set/Database 11 to 12 Migration Options Task: Migrating production Oracle EE 11.2.0.4 single instance database with NLS_CHARACTERSET WE8ISO8859P1 to existing remote ...
12
votes
1answer
42k views

Why default character_set_server is latin1?

I am using MySQL 5.5 and when I show variables about charset, I have +--------------------------+----------------------------+ | Variable_name | Value | +--------------...
5
votes
1answer
2k views

How do I list all available encoding types available in postgreSQL?

SELECT datname, pg_encoding_to_char(encoding) FROM pg_database; …lists all the databases, each with its encoding type. However, I am trying to find out what are all the encoding types available in ...
2
votes
1answer
2k views

Remove question marks from database(latin1_general_ci table)?

How can I remove question marks(not diamond shaped) from a latin1_general_ci MyISAM table? I tried going back to utf8 and tried to apply things in https://stackoverflow.com/questions/1476356/...
1
vote
2answers
9k views

How do I set MySQL's “character_set_server” and “collation_server” variables when creating a database?

I'm using MySQL 5.5.37. How do I set the default "" and "" variables of my database when initially creating my db? I'm logged in as the root user but my command is not cutting it, as you can see ...
2
votes
2answers
9k views

SQL Server to MySQL migration - how can I remove UCS-2 surrogate pairs in SQL Server?

I have been tasked with migrating a SQL Server 2005 database to MySQL 5.6 (these are both database servers runnig locally) and would really appreciate some help. -------Edit - Answered------- This ...
2
votes
1answer
76 views

Extract all unique chars from all texts across the table

I have a huge mysql table (20 columns by 320.000 rows) that contains a lot of text from a lot of languages and the problem is that I need to identify all the unique characters in that table. For ...
13
votes
3answers
26k views

Modify all tables in a database with a single command

Is there a single or a one line command to modify all tables within a database. I would like to issue this command in every table within a database: ALTER TABLE `table_name` CONVERT TO CHARACTER SET ...
1
vote
1answer
731 views

German umlaute represented by questionmarks when latin1 is used

I'm almost certain this has come up before but I couldn't find anything regarding it. My problem is that I've a database and a database server (and every table and column inside) set to latin1/...
1
vote
0answers
305 views

Loading MySQL Dump From one Character Set to Another

As you can see from these configuration differences, the MySQL server is configured with latin1, while the MariaDB server is using utf8mb4: Variable MySQL Server MariaDB Server ...
2
votes
2answers
3k views

UTF8 Trouble while migrating from MSSQL to MySQL with MySQL Workbench

I am tasked with migrating part of our database from an on-site MSSQL server to an Amazon RDS MySQL. This will be my first attempt with a database migration, so I am doing a dry run from our MSSQL ...
3
votes
4answers
59k views

Converting varbinary data to varchar in SQLServer leads to unexpected results

I need to fix some data conversion issue in SQL server 2008. I got some requirement change on storing the data. Without much care I converted existing varbinary data to varchar using CONVERT(NVARCHAR(...
15
votes
2answers
32k views

How can I insert smiley faces into MySQL ( 😊 )

I'm on MySQL 5.5.21, and trying to insert the '\xF0\x9F\x98\x8A' smiley face character. But for the life of me, I can't figure out how to do it. According to various forums which I've been reading, ...
0
votes
2answers
10k views

MySQL Workbench run SQL script file Character Set encoding issue

Upon running a .sql file for creating a schema in MySQL Workbench 6.1, it prompts a window saying it cannot decide the right character set What's the proper thing to do?