Questions tagged [archive]
The archive tag has no usage guidance.
113
questions
-1
votes
1
answer
324
views
Archiving strategy
I have an instance with only one database which contains 4 years of data (400 gigas). I name this instance inst_live
I want to implement this following archiving strategy:
create an archive instance (...
- 331
3
votes
1
answer
2k
views
DELETE ... IN hangs after deleting half of a large table (even for deleting 10 rows)
I'm having trouble with a DELETE hanging, even for a small number of rows (10) in a large MariaDB InnoDB table.
Background
I had a large table (~400,000,000 rows) that needed to have rows archived ...
- 76
0
votes
1
answer
2k
views
Copy a mongo db collection without locking whole mongod instance
I am trying to run mongodb copy collection on same server.
Requirement is we delete database as per our archival policy but we need to keep one collection from this data as a backup in separate db on ...
- 511
1
vote
1
answer
1k
views
Restoring dump(backup): ERROR 1022 (23000) at line 44: Can't write; duplicate key in table
I'm doing tests to change a current table from my InnoDB database to Archive, but I had a problem trying to restore a dump after the change.
After several tests, the problem is related to the value ...
0
votes
1
answer
4k
views
MySQL - Delete older Records from a huge table
I have some huge tables which have around 10years data, and each table has approx 10000000+ rows.
Basically, I want to remove older than 2 years data and make a copy of deleted data in a separate ...
- 1,910
2
votes
1
answer
3k
views
Archiving data in SQL Server with stored procedure [closed]
Database in SQL Server 2014 has one table and is consuming around 17-20 GB of disk space each day. Assuming that level of usage remains fairly consistent and not accounting for lower usage on ...
- 135
0
votes
1
answer
1k
views
Recovery using Archive redo log files
As I'm new in using RMAN and archivelog, I've a few doubts regarding to this. My database is Oracle 11g(windows platform). It was previously in noarchivelog mode and recently I've changed it to ...
- 152
0
votes
1
answer
46
views
Help with updating and archiving data
I'm building a MySQL database and a frontend. One function of the database application is to make an invoice. I'm looking for a way to archive all of the data that went onto the invoice so that if ...
- 143
1
vote
1
answer
704
views
Best practice for storing large files (+1GB each) [closed]
I am looking to build a big data platform for weather forecasting. I will be using a numerical model known as WRF which takes in GFS files and produces files which can be over 1GB each.
I will be ...
- 181
0
votes
0
answers
289
views
What index type to use for a log
I have a table in which I will store messages (as in chat messages).
The table will be appended to a LOT, rows being inserted as messages fly by, much more often than entries will be updated.
Older ...
- 613
3
votes
1
answer
243
views
Archivelog redundancy
I need to enable archivelog. But sometimes database can't connect archivelog destination (NFS disk) and shutdowns. I can set two archivelog destinations and one of them is not NFS disk (local disk).
...
- 163
0
votes
1
answer
129
views
Archiving tables with Access frontend and linked SQL Server
I'm working on a project where the user has an Access 2013 MDB database with forms, reports, and queries. We're converting it to use linked tables to SQL Server 2008 R2. All the linked tables seem to ...
- 123
2
votes
1
answer
1k
views
Truncate text output of COPY command for postgres
I've got a script that copies every table in a schema to a csv using the following:
psql -Atc "select tablename from pg_tables where schemaname='$schema'" --host=$host -w --user=$user $database |\
...
- 317
1
vote
3
answers
5k
views
Specify cleanup by file age - PostgreSQL 9.2
I want to keep my wal_files for 30 days, using the pg_archivecleanup.
I've followed these scripts:
https://stackoverflow.com/questions/31346606/postgresql-automatic-archive-purge-not-occuring
and ...
- 181
2
votes
1
answer
88
views
"symlink" data to new database
I am just trying to figure some ways to do manage archiving of some/most of our Application data within the database and wondering if something like this would be possible:
Archive anything with a ...
- 23
24
votes
3
answers
10k
views
What's the best way to archive all but current year and partition the table at the same time
Task
Archive off all but a rolling 13 month period from a group of large tables. The archived data must be stored in another database.
The database is in simple recovery mode
The tables are 50 mil ...
- 24.1k
0
votes
1
answer
119
views
Redo/Noredo in Oracle
I have an Oracle 11.2.0.3 about 700GB in size running in noarchivelog mode in a pretty slow storage setup. It barely gives IOPS and there is resource crunch in terms of hardware resources. The ...
- 1,876
1
vote
1
answer
2k
views
DB2 archive log extraordinary growth for any operation after runstat/reorg [closed]
My environment:
DB2 10.1.4 Enterprise, IBM Security Identity Manager 6.0 FP6, AIX 7.1
Each archive log have a size of 40MB
Yesterday, we do a maintainance on ISIM database by doing online backup. The ...
- 11
0
votes
1
answer
226
views
Use a SP to Archive/Revision related records in several related tables?
I have a database for an application that has a complicated relational table structure. Is there a good way to create revisions of the data, or archive the data before a user makes changes?
Ideally ...
- 31
2
votes
0
answers
307
views
SQL Server archiving
We are trying to archive our data for the first time in our database. The database is around 250 GB. Our approach is as follows. Create a copy of those tables without any index or constraints. And ...
- 161
2
votes
0
answers
674
views
Any way to ensure that Change Data Capture clean up process does not delete the change data that you haven't processed yet?
I'm using CDC feature to track changes that are being made, since the cleanup period is set to 3 days by default, I have to run jobs to archive this change data from the CDC system tables to my tables....
- 535
2
votes
1
answer
1k
views
postgres: WAL files not being deleted during PITR
I have got an issue with setting up PITR on my postgres server:
WAL archiving and restoring works quite well, as well as restoring to a specific point in time. The issue however is, that if i do a ...
- 43
5
votes
1
answer
803
views
Postgres: Is migrating old records to separate table and creating new aggregated records a good strategy to improve search speed?
I have a table with 1M+ records. New records are created and updated each day each time an event occurs for each type of event (which there are many). I frequently need to find sums across many ...
- 1,163
0
votes
1
answer
2k
views
Adding columns & index to a huge table
I'm working with a Rails app backed by a MySQL database. One of the more-frequently used models is backed by a table with over 200,000,000 rows (and growing). We've been aware for a while that the way ...
- 552
5
votes
1
answer
907
views
Moving Transaction Data To Another Database For Reporting Purpose
We got a requirement from our developer group, to do the followings:
Frequently (every 30mins) move the transaction data out of live database to another database
Secondary database will be utilize ...
- 299
2
votes
2
answers
2k
views
How to archive a whole database?
I have a database that is not going to be used anymore but that needs to be kept around for a long time. I'd like to remove it from the production system. My goal is to save storage space when ...
- 7,300
0
votes
3
answers
506
views
Schema Design with "Seasonal" Data
I am developing a SaaS web application for School Management. What I need help is this:
The whole application is purposed for the current year that the School is in. However, some data and ...
1
vote
1
answer
235
views
Delete Old Archivelogs from missing database
We have deleted a database but the archive logs remain. We need to delete these as they take a lot of space:
Since the database is deleted, it is not in the rman catalogue so I cannot use delete ...
- 266
4
votes
1
answer
204
views
DB2 - what happens when SQL archive log file reches its maximum value (S9999999.LOG)
we have DB2 in archive mode.
archive log files are created and deleted from the disk.
What will happen when archive log file reaches its maximum value for the name (S9999999.LOG) will it start to ...
- 675
0
votes
2
answers
2k
views
Is there a faster way of moving data between databases than CTEs?
I use the following query on SQL Server 2012 Express to move data that is older than 4 days old out of one [primary] database and into another [secondary database] for archiving purposes. The only ...
6
votes
1
answer
357
views
Log shipping with a monthly archival process
We will be implementing log shipping in our production environment in the next weeks.
We perform a monthly "cleanup" of the database, whereby we set the database to the SIMPLE recovery model, copy ...
- 287
1
vote
0
answers
68
views
How to keep archive table accessible for some users which is not frequently accessible?
I have partitioned my table based on some boundary ranges.
My Database is built at MSSQL server 2008 R2.
I have done partitioning for a table which has 40 million records in it. Now it's time to ...
- 163
0
votes
1
answer
1k
views
DB2 PURGE (old Online Backups and Archive logs) - some of the archive logs are not removed
DB is in Archive Mode.
We are creating full Online Backups every night at 23:00.
We set automatic removal of old online backups and archive logs.
AUTO_DEL_REC_OBJ ON
NUM_DB_BACKUPS 2
...
- 675
2
votes
2
answers
802
views
DB2 - Why new multiple C000000x subfolders are created in Archive Log folder?
After switching to Archive mode (from Circular mode to keeping archive logs on the disk) we had C0000000 folder where archive logs were copied.
Now I noticed that folders C0000001, C0000002, C0000003 ...
- 675
1
vote
3
answers
24k
views
DB2 ARCHIVE mode - Can all archive logs be deleted after doing the FULL OFFLINE backup?
I am interested in one thing, if I understood correctly.
DB2 is in Archive mode (online backups are made and archive logs keep coming which is OK).
If I made offline full backup today and I know I ...
- 675
0
votes
2
answers
826
views
Database returned to CIRCULAR mode but logs are still being archived to old location
my DB2 database (v 9.7) is in Circular mode.
Current Logging Type:Circular
(USEREXIT) = OFF
(LOGRETAIN) = OFF
(LOGARCHMETH1) = OFF
(LOGARCHMETH2) = OFF
(LOGPRIMARY) = 10
(LOGSECOND) = 10
Path to log ...
- 675
2
votes
1
answer
9k
views
Difference between alert log and archive log in oracle databases
I don't know anything about oracle databases. Actually I'm asking this question for my friend (He currently doesn't have access to internet!).
He wanted to know that what's the difference between ...
- 123
2
votes
3
answers
2k
views
Extracting Data from multiple archive tables
I am developing a report in report builder 3.0 where I am extracting data from a table dbo.odcalls.
The problem is this table is archived on monthly basis to a separate database (HN_Backup), and I ...
- 29
1
vote
1
answer
497
views
Where to put standby control file in Physical standby database?
I am creating a physical standby database for which I am creating a standby control file using command = ALTER DATABASE CREATE STANDBY CONTROLFILE AS '/oracle/dbs/stbycf.ctl';
but It creates only one ...
5
votes
1
answer
9k
views
What is the use of Archivelogs?
Hi I am new to Oracle Database . Using Oracle 11g R2
I want to know the purpose of archive logs created at archive log destination, how they are helpful in database backup.
Suppose I am having ...
4
votes
2
answers
5k
views
Change table from InnoDB to ARCHIVE in MySQL
I try change my table from InnoDB to ARCHIVE with SQL command:
ALTER TABLE data_obook ENGINE = ARCHIVE;
But it always show me only error:
#1005 - Can't create table 'coincity.#sql-1350_8a' (errno: -...
- 143
1
vote
0
answers
742
views
pt-archiver and foreign keys?
How does pt-archiver handle foreign keys?
Does it archive associated data? (seems not but the documentation is not very clear to me)
And if not, how could one perform an archive of a table with all ...
- 11
0
votes
1
answer
357
views
Seg faults in Percona Server 5.6.19
Trying to figure out what went wrong here. Any advice would be appreciated. This server is running a new installation of Percona Server 5.6.19 on CentOS 6.5
16:05:46 UTC - mysqld got signal 11 ;
This ...
- 53
4
votes
2
answers
2k
views
What is the proper way to store a full table of data outside of a database? It needs to be able to be restored as well
I have a large SQL Server 2005 database that hasn't had the best maintenance over the years (I just took it over recently). There are around 100 tables that can be completely removed from the ...
- 45
1
vote
0
answers
64
views
periodic data move from local server to remote server
I have a local PostgreSQL server that is recording data on a solid state drive of less than 8 GB free space on a Windows 7 embedded 32 bit machine. In order to make a backup and store large data I ...
- 21
1
vote
2
answers
255
views
Archiving data from logging db (high writes, no reads)
I have a logging database with a few lookup tables and one massive event table that has 79 million rows. On busy days my code inserts over 3 million rows, so the event table would be enormous in ...
- 339
1
vote
1
answer
827
views
Is it possible to archive table rows of an RDS read replica?
I would just like to know if I can purge 60 days old rows from a replica. Would the replica just copy the rows again from the master after deleting the rows? Because what I would really like to do is ...
- 13
0
votes
2
answers
9k
views
Accessing Shared Folder Using Oracle Database
I have two machines A & B. I shared a folder from machine B and mapped it as a drive on machine A. Now I want to configure my Oracle Database in Archive Log mode and want to set the Archive ...
- 75
4
votes
1
answer
1k
views
Deleting Rows is Increasing Index Size
We have a very large table in a SQL Server 2008 R2 Standard server which I am archiving rows by copying them into another database on a separate disk and then deleting them from the original table ...
- 437
0
votes
1
answer
2k
views
DB2 - Archive mode - large number of logs in logarchmeth1 folder
maybe for someone this is begginner's questions. I read lot of documentation and set:
`LOGPRIMARY 6
LOGSECOND 4
LOGFILSIZ 4096
logarchmeth1 Disk - C:\archive
logpath C:\active`
Number of logs ...
- 675