Questions tagged [utf-8]
Unicode variable-width character encoding (between 1 and 4 bytes per code point).
23
questions with no upvoted or accepted answers
3
votes
1
answer
5k
views
Why pgAdmin4 invoke "'utf8' codec can't decode byte 0xe9 in position 42: invalid continuation byte" error?
I'm newbie in postgreSQL ,when I'm trying to create a new local server using pgAdmin4 ,it shows me this error :
'utf8' codec can't decode byte 0xe9 in position 42: invalid continuation byte
I'm ...
2
votes
1
answer
416
views
How can I detect double-encoded MySQL columns and rows, and validate the repair?
My database provider, bless their hearts, migrated our MySQL databases to another server recently, and introduced double-encoding of UTF-8 data via Latin1 into our text data. Strings like 'emdash—here'...
- 191
2
votes
2
answers
4k
views
How to bulk convert ISO8859 text in Text columns to UTF8 in nvarchar(max) columns?
I've been struggling for days with a problem on a MS SQL database. Here is the situation: I have an old Open Source PHP application (Limesurvey version 1.92) running on a Windows 2008R2 server, with ...
- 21
2
votes
0
answers
1k
views
Convert large utf8 database to utf8mb4
I have a large database (~450gb) which I need to convert from utf8 to utf8mb4.
I'm aware of the steps I need to take, but is this practical on tables containing this much data? I'm mainly concerned ...
- 188
2
votes
1
answer
158
views
Find efficient way of migration 2TB GBK table in SybaseIQ to UTF-8 files
My project need to migrate more than 2TB raw data from SybaseIQ to another Database. SybaseIQ using GBK, the target Database using UTF-8, the target database can only load from UTF-8 files.
We use ...
- 131
1
vote
0
answers
1k
views
PSQL console encoding
How can I have a working PSQL console using UTF8 encoding under Windows?
I have a Windows server and client. The Postgres 12 database contains tables with content in multiple languages (ex: English, ...
- 111
1
vote
0
answers
293
views
MariaDB REGEXP_REPLACE Invalid utf8 byte sequence
I'm working with a fairly old (15 years) old database. It started as a MySQL3, was upgraded several times, the frontends had problems with proper encoding, the whole database was converted to utf8mb4 (...
- 111
1
vote
1
answer
226
views
Can't set up Unicode support
I am creating a toy website locally with XAMPP and I want it to support Unicode.
index.php contains a simple form that I can use to add a new entry (a UTF-8 string) to a table "myTable" in the DB. ...
- 111
1
vote
0
answers
58
views
Finding and replacing non-specific text to lowercase variant
I've been cracking my brain on a problem that I had at work. In one of my tables is a bunch of rows, with a certain column that contains XML data that has several properties like this: (simplified)
&...
- 111
1
vote
1
answer
2k
views
MySQL/MariaDB connection in asp code encodes wrongly charset utf8 at insert or update in data base
I can't get a simple update or insert to save special äöü characters. Instead they are being stored as äöü.
The website displays äöü characters correctly if they are already stored as äöü in the ...
- 133
1
vote
2
answers
5k
views
mysqldump collation issues
I have tried my hand at building a shell script to backup our wordpress database using tar balls and chron jobs on a Debian environment.
The problem I am facing now is that our wp database after ...
- 19
0
votes
1
answer
164
views
SQL Server 2019, utf-8, replication problem
I know this is late to the game, but we're just upgrading to Sql Server 2019 after years and years on 2008.
I started using the Latin1_General_100_CI_AI_SC_UTF8 collation as an experiment and at least ...
- 207
0
votes
0
answers
100
views
Migrate postgresql to MariaDB
I try to migrate mysql Zabbix database from Postgresql to MariaDB using MySQL Workbench migration Wizard
I have compiled psqlODBC and enable it
When I setup the source database in the wizard the test ...
- 1
0
votes
0
answers
1k
views
How to convert UTF8 general in UTF8 unicode?
Short:
My tables have the collation utf8mb4_unicode_ci, but the data itself is utf8mb4_general_ci and now I like to know how I can convert it into unicode?
Long:
I used this query to convert all my ...
- 133
0
votes
1
answer
714
views
converting latin to utf8mb4 causes questionmarks
The original format of the data is unknown
The new table is in utf8mb4_general_ci
If I do CONVERT(BINARY CONVERT(column USING latin1) USING UTF8) as mentioned here - it fixes all text, but converts ...
- 1
0
votes
0
answers
557
views
Will MariaDB treat ut8/utf8mb3 and utf8mb4 collations as compatible?
Background on relevant character sets
MySQL and MariaDB support the deprecated utf8mb3 character set and collations. (utf8 is currently an alias for utf8mb3.) This supports all Unicode code points on ...
- 123
0
votes
1
answer
204
views
Arabic language search in codeigniter error : Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE)
Arabic language search in codeigniter error : Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE)
In English language search is working
JOIN Query to use to ...
- 109
0
votes
0
answers
424
views
ALTER TABLE query to convert table to utf8mb4_bin takes many hours - how to optimise this?
I have a table which has approx 15 million rows - I won't add the schema here but it has 96 columns (far too many in my opinion).
The current table collation is latin1_swedish_ci but for full emoji ...
- 111
0
votes
0
answers
92
views
Database Importing Collation
Migrating from DB2 found this error message:
Error message: Incorrect string value: '\xF2\xAC\x9F\xB0or...' for column 'column_name'
This is when trying to import an XML to MySQL. I should have a ...
- 640
0
votes
1
answer
1k
views
Insert and Update with AES_ENCRYPT is mangling character set on double byte script
DB and fields are UTF8_unicode_ci collation - MySql v 5.6
HTML charset is utf 8
Double byte script was entered successfully prior to this issue (Chinese, Japanese, plus Cyrillic etc) when using ...
- 117
0
votes
1
answer
176
views
Implicitly (or proxy) convert to Nvarchar on incoming queries from legacy or 3rd party applications
We have a 3rd party application of which we don't have the source code. This application executes queries on our database without using the "N" prefix before literal strings. It does this in inserts ...
- 553
-1
votes
1
answer
1k
views
UTF-8: showing correct in database, but not in webpage
When i upload data from php post forums "हिन्दी" language, changed into "हरिà" in database but looking correct in webpage,
and
when i upload data through phpmyAdmin from csv file "हिन्दी" ...
-1
votes
1
answer
2k
views
Workbench Error Code 1267 - utf8_unicode and utf8_general
I've recently just swapped all of a databases tables and columns to utf8_unicode_ci from the weird collection of about 3-5 different collations they were previously (don't ask... not my database)
So, ...
- 99