Questions tagged [schema-migration]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
30 views

Best approach to extract 1000 Gbs of Data from Teradata

What should be the best approach to download data from Teradata using python ? I have more than 3000 GBs of data to be migrated from teradata to another code service. Any approach or advise would be ...
user avatar
0 votes
0 answers
22 views

Horizontal scaling with database schema

I am designing a database schema for our customers on-premise, which will be moved to Azure PaaS later. Regarding the "scale out" strategies I lean towards to create "one database",...
user avatar
  • 266
1 vote
1 answer
37 views

Adding data to a DB as migrations

Some Background We currently have a PostgreSQL DB that is "read-only", i.e. no user is allowed to write to it and all insertions are done in a controlled manner. For a while, these were done ...
user avatar
  • 111
0 votes
2 answers
73 views

Error when migrating MySQL 8 to SQL Server 2019

I get an error while migrating a database from MySQL 8.0 to SQL Server 2019 using the SQL Server Migration Assistant. The error message: ExecuteReader requires an open and available Connection. The ...
user avatar
0 votes
1 answer
231 views

Achieving best practice schema and permissions management on PostgreSQL

I have a PostgreSQL database (12, moving to 13 imminently) with a single (Rails) application running on it, and no other users or systems connecting. The application uses the postgres user to connect ...
user avatar
0 votes
0 answers
68 views

how to sync one table of AWS RDS to another RDS

I have requirement like need to synchronize one table of data (contain user list) in AWS RDS instance to another RDS Instance. only particular user's table need to synchronize. ex: RDS-1 have schema ...
user avatar
  • 1
0 votes
1 answer
52 views

Table design comment_seen vs comment_unseen — migrate data from one to another

I have system that allows comments posted by users and tracks which users seen which comments. The read/unread state is tracked within comments_seen table. Surely enough, it grow tremendously. My goal ...
user avatar
1 vote
3 answers
141 views

Is it good practice to refer to a table with different names in a database schema? [closed]

We have a database currently running with a table named a certain way (let's say thing for the sake of example), and references to that table named the same way (FK would be named thing_id for ...
user avatar
  • 11
1 vote
1 answer
199 views

Error: Not run migration 1604169742656_add-users-table is preceding already run migration 1604024614269_table-comments

I was trying to run a migration file to create a table of users but I kept getting the following error: Error: Not run migration 1604169742656_add-users-table is preceding already run migration ...
user avatar
  • 261
0 votes
0 answers
843 views

Best practice privileges and roles for postgres schema migration

I'm having a re-look at roles and privileges in postgres to minimise the damage that a compromised account can do. Ownership and migrations is a part I'm having trouble getting my head around. As I ...
user avatar
  • 459
0 votes
1 answer
59 views

Deploying Oracle ADW Changes from development environment to production

I'm currently running an Oracle Autonomous Data Warehouse (Oracle's cloud-based database offering) on version 19c. I have a development database on the Always Free Tier and my production database is a ...
user avatar
0 votes
1 answer
1k views

MariaDB Replication - Replicate only specific tables and views

Note: A backend developer here with little to no experience in setting up database servers and replication. What needs to be done Setup DB replication of an existing database with the following ...
user avatar
0 votes
1 answer
24 views

Data migration: copy data with insert select and fill unique column

I have some tables in Postgres like this. create table foo ( txt text ); insert into foo (txt) values ('a'); insert into foo (txt) values ('b'); insert into foo (txt) values ('c'); create table ...
user avatar
  • 151
0 votes
2 answers
212 views

What's the best way to migrate a database to a server of a lower SQL version?

I have Database A on SQL Server 1 that is SQL Server version 2016. I need to migrate it to Server 2 that is SQL Server version 2012. Database A is pretty small, only about 5 GB total. I don't think ...
user avatar
  • 24.2k
0 votes
1 answer
140 views

How to perform schema migration from array to many-to-many to lookup table?

I currently am storing values in a column of type array like follows (this is just an example): CREATE TABLE blog_posts( id INTEGER PRIMARY KEY, blog_title TEXT, tags TEXT[] ); With the ...
user avatar
13 votes
0 answers
3k views

Best practices for keeping protobuf spec in sync with relational database (e.g. PostgreSQL)

1. We have a schema definition in Google's Protocol Buffers format that we use to generate code for different gRPC implementations (Python, PHP) 2. We have a database (PostreSQL) that is initialized ...
user avatar
  • 333
0 votes
1 answer
48 views

Migrate legacy application to new db/schema

I apologize if I made any mistake/missing info, fist post here! I am in the process of rewriting a website from scratch to a newer tech stack with a completely redesigned architecture. The website in ...
user avatar
  • 101
0 votes
1 answer
79 views

Restructuring table - start with PK or not?

I am restructuring a bunch of tables in my database (in this case using a smaller data type for some columns - in most cases cutting those by ~50%, and they tend to be large columns). I've gone ...
user avatar
  • 334
0 votes
1 answer
111 views

How to speed up Oracle to PostgreSQL data transfer

I have an Oracle schema that I am transferring to PostgreSQL with ogr2ogr. This particular table has 5 columns with number(22) each. There are some 300M rows. In under 10 minutes I can transfer this ...
user avatar
  • 213
2 votes
0 answers
769 views

Received an unsupported type from Postgres. (14) (SQLGetData)

I have database in PostgreSQL. It is simplest possible database with schema presented here: http://www.postgresqltutorial.com/postgresql-create-table/ I want to migrate it to MySQL. I trying to ...
user avatar
  • 187