Questions tagged [archive]
The archive tag has no summary.
117 questions
0 votes
1 answer
86 views
MSSQL Data retrieval logic
I have two tables that store similar data but for different time periods: MainTable: contains records for the current year. ArchiveTable: contains records from previous years. Both tables have a ...
1 vote
2 answers
240 views
How to solve "Space allocator cannot allocate page in database" error
When I insert data into a SQL Server database, I got this error Space allocator cannot allocate page in database Even though I have enough space for the disk. Database size is 33 TB. And data is ...
- 21
0 votes
1 answer
196 views
PRUNE LOGFILE PRIOR TO isn't deleting archived log files
DB2 UDB 11.5.7.0 $ db2 get db cfg for PRPT01D | grep LOGARCH First log archive method (LOGARCHMETH1) = DISK:/udb/alogs/ Archive compression for logarchmeth1 (LOGARCHCOMPR1) = OFF ...
- 694
0 votes
1 answer
179 views
PostgreSQL: Best practises for Deleting huge volume of Data in Replicated Environment
We have a prod database (PostgreSQL13) with a hot-standby(physical replication) as well as logical replication to a different subscriber server. Now we are in requirement of purging few year's record ...
- 700
0 votes
1 answer
54 views
Manage the amount of data on tables
I can have several tables with 10+ millions rows in by year. I would to know what's the best approach to maintain responsiveness with this amount of datas and I have two ideas. Don't touch these ...
- 1
0 votes
0 answers
47 views
SQL Server database migration issues
I have a system with two servers and three client workstations. Servers were configured to work as principal/mirror servers (mirroring was configured with certificates). I have two databases in SQL ...
- 1
1 vote
2 answers
8k views
Best Practices to archive or remove old data in SQL Server 2012
Our application has numerous tables that contain outdated data, some dating as far back as 2010. Despite having indexes defined on these tables, many of the index seeks retrieve old records, which is ...
- 25
0 votes
2 answers
325 views
Pt-archiver csv double quote missing for some fields
I am trying to use pt-archive to archive my database. Below is my script for the archiving process. pt-archiver --source h=localhost,D=***,t=** --user=*** --password=**** --where "dateTime<'...
- 227
1 vote
1 answer
129 views
data archival postgres
I have this code to delete rows with column "id". I want to limit the number of rows deleted in each loop. This code deletes the first 25k rows and the next loop deletes nothing since its ...
- 101
1 vote
0 answers
497 views
"Snapshot" of Historical Data for Analysis Purposes
I pull monthly aggregate data from a SQL database. I store the aggregated data in a separate table in the same database (so I can quickly grab numbers from six months ago, for instance). My issue is ...
0 votes
1 answer
2k views
Archiving SQLite DB with WAL mode
I have an SQLite database gapongasi.db configured using WAL mode and I want to have daily archive with tar(1). With WAL, there are two files being used (1) gapongasi.db-wal and (2)gapongasi.db-shm, ...
0 votes
1 answer
2k views
understanding pg_wal and archiving
So I inherited this database. At the very beginning, there were already some files on pg_wal. Then, after some weeks, I do count SELECT COUNT(*) FROM pg_ls_dir('pg_wal') WHERE pg_ls_dir ~ '^[0-9A-F]{...
- 327
0 votes
1 answer
129 views
Why is a Move and Delete Data (approx 1/3 of the table) using (CTEs) WITH statements taking hours on a 600m row table taking 3+ hours - best approach?
Am not sure if this is the best method of moving/deleting data. The play table has 700m+ rows and game table has over 600m+ rows. I have 2 tables play and game, information from the play table is ...
- 459
1 vote
3 answers
2k views
Database archiving strategy
I work on a payment system (a bit regulated area with requirements to store really old data for audits & customer requests). We have SQL Server 2016 (but will move to 2019 soon). System is 16 ...
- 161
1 vote
1 answer
718 views
Best way for archiving old mysql records
we have a Ruby on Rails app with a MySQL DB (on AWS RDS). Some of our tables have a large number of records ~100 million and this number is rapidly increasing every month. Most of the records in these ...
John Stevenson