The name given to the process of encoding data such that it uses lesser number of bits as compared to the original representation.

learn more… | top users | synonyms

1
vote
2answers
55 views

Please explain the difference between row and page compression

I'm trying to determine which to apply and when is the appropriate time to apply compression. I'm posting this question to get insight from this community. I have read several articles, but wanted to ...
0
votes
1answer
35 views

MySQL MyIsam Compressing tables

Im packing big MyISAM tables with myisampack and came up with the following issue. (MariaDB 10.1.14 64bit windows) Indexes are rebuilt after packing the tablewhile running myisamchk -rq, so, it doesnt ...
0
votes
1answer
119 views

Migrate database from SQL Server 2008 Enterprise to SQL Server 2014 Standard

I need move database with "data compression" from SQL Server 2008 Enterprise to SQL Server 2014 Standard. But Standard edition does not support "data compression". How can I disable "data ...
0
votes
1answer
31 views

PostgreSQL values to unique dictionary

I have table with one billion rows and more than 50 columns. I need to reduce size and speed up queries, backup, exports, etc. Some columns contain f.e. only hundreds of distinct values which are long ...
0
votes
1answer
45 views

Restore a database with compression on a non-enterprise edition SQL Server

Is it possible to restore a compressed an object from backup without the Enterprise Edition? I'm getting the following error after a RESTORE DATABASE operation. Msg 3013, Level 16, State 1, Line 2 ...
1
vote
1answer
262 views

Data compression with in memory OLTP

Will having data compression enabled decrease the amount of memory used by an in memory OLTP table? If yes I assume the CPU workload will increase.
7
votes
2answers
2k views

Alternative way to compress NVARCHAR(MAX)?

I am trying to compress some tables that have NVARCHAR(MAX) fields. Unfortunately, the row and the page compression do not have the desire impact (only ~100/200 MB saved for 20 GB table). Also, I am ...
3
votes
1answer
216 views

sp_estimate_data_compression_savings for column store compressions

Is there a way to get compressions saving for column store and column store column store archival compression? In order to check these compressions saving I have to drop all clustered and non ...
0
votes
2answers
42 views

UnShrunk SQL Server database restore which is larger than available disk space

I cannot restore a Microsoft SQL Server database due to lack of hard drive space. The original database was 1.6TB and approximately 1.4TB was deleted from it and a backup was taken without shrinking ...
10
votes
2answers
125 views

Does there exist a way to determine the exact file that contains an allocation unit in a filegroup of multiple files?

I was hoping to get a granular view of which database files contained which allocation units for the various HoBTs (both aligned and non-aligned) living in a database. The query I've always used (see ...
4
votes
3answers
3k views

Set Backup Compression on SQL Server 2008R2 on by default

I can't seem to find the option to set the server property that will enable compression on SQL database backup to be ON by default, so I don't have to manually set it every time. Can anyone point me ...
0
votes
0answers
51 views

Oracle - compressed subpartitions in uncompressed table

I am working with Oracle 11.2. I have table which on subpartition level has in DBA_Tab_subPartitions column COMPRESSION set to ENABLED for all subpartitions. But on partition level in ...
1
vote
0answers
51 views

How to achieve maximal data compression using SQL Server? [closed]

I'm planning to get some data that is uncomfortably large for me. The data is mostly textual, shares common vocabulary and is versioned, which means it must be very amenable to compression. I'm ...
6
votes
1answer
224 views

How does SQL Server calculate the initial size of a (compressed) backup?

When a backup is created, SQL Server guesses(?) the a size of the intial backup file. Later on, maybe when it appends the log the size will be re-adjusted, sometimes multiple times until the final ...
7
votes
1answer
204 views

Effect of changing data types with row compression enabled

The company I work for has a couple of SQL Server databases with tables containing +- 500.000.000 rows. We are running Enterprise editions of SQL Server 2008R2 and 2014. Big data types When I look ...
0
votes
0answers
36 views

MongoDB: poor compression rates

I'm importing a small set of data from Oracle in MongoDB. Basically, I have a table which is about 1Gb in Oracle (avg_row_len x nb. rows, i'm not counting the index sizes. Though data is compressed). ...
2
votes
1answer
178 views

Backup File Size Almost 50% of Database File Size with TDE Enabled

I receive a full backup of a very large database once per week from a vendor. It contains transactional data which we then load into our data warehouse. Fully restored, the database is around 707GB. ...
1
vote
1answer
967 views

Mongo Db server status with wired Tiger

I was testing my DB with Mongo 3.0 wiredTiger setup. After restoring my database with wiredTIger i ran db.serverStatus. I found following in console output. "bytes currently in the cache" : ...
1
vote
1answer
27 views

Are toast columns compressed also in shared_buffers?

Reading here I cannot find a clear answer: http://www.postgresql.org/docs/9.1/static/storage-toast.html I need to know if setting storage to EXTERNAL for a particular column, I can gain a little ...
0
votes
0answers
50 views

Does MySQL InnoDB compression combined with Windows compression save more space?

We have a very large MySQL InnoDB database, compressed using the following syntax at the end of the table declaration: ENGINE=InnoDB ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=4 We also have windows ...
3
votes
2answers
138 views

will table partitioning and compression help heavily used OLTP database?

We have a very big table which is over 300gb with over half billion rows in it. This table is used for audit purpose for all critical applications. A lot of inserts are happening per seconds. Due to ...
0
votes
1answer
95 views

error recovering pg_dump compressed file

I produced this backup: pg_dump -v -Fc -Z5 -f thebackup.dmp.gz thedb I can't open the dump with gzip, 7zip... I could recover the same files in the past without using -Fc parameter. Is it possible ...
2
votes
2answers
550 views

Export a table and zip with password

I would like, from TSQL, to use a view to extract data from a table, output it with BCP, then use non 3rd party tools to ZIP it with a password and AES encryption. Optionnally, I could use a 3rd party ...
1
vote
0answers
97 views

Estimating compression ratio for SecureFile LOBs?

We made a migration from Oracle 10 to 11.2. Our lob objects are currently stored in the original LOB storage architecture. But 11g introduced the SecureFile storage architecture and we want to use ...
5
votes
1answer
130 views

Postgres: Is migrating old records to separate table and creating new aggregated records a good strategy to improve search speed?

I have a table with 1M+ records. New records are created and updated each day each time an event occurs for each type of event (which there are many). I frequently need to find sums across many ...
0
votes
1answer
466 views

Sql Server thinks I have different Data Compression when swaping partitions

I am setting partition switching for my database. I created a script using SqlCmd variable so that the same script would make both my source and target tables for partition swapping. Here is an ...
9
votes
1answer
400 views

What is the different between compression on the PK vs. on the Table?

Data compression can be set on the table: CREATE TABLE dbo.SomeTable( SomeId [bigint] NOT NULL, OtherId [bigint] NOT NULL, IsActive [bit] NOT NULL, CONSTRAINT [PK_Some] PRIMARY KEY ...
1
vote
0answers
118 views

Data compression within Internal Tables in SQL server 2008R2

We are doing downgrade from enterprise to standard for couple of servers which are not using any enterprise features: For one of our TFS(Team foundation server) database TFS_resx, when we ran ...
2
votes
0answers
1k views

What are the compression options for storing large amounts of text in Postgres?

I need to store large amounts of text in Postgres, mainly command logs and the output of long running commands and need to know if there are some settings that could help compress the data ...
4
votes
1answer
246 views

IO request time and less write latency

I am facing issues related to constantly growing log file due to which I am getting error. When I checked SQL Log I found below messages (error log is filled of these messages almost 90%) SQL ...
4
votes
1answer
187 views

Page compression not working?

I have created a table where I have around 100 partitions (per month), all of them are configured to use page compression. After that I'm inserting data to this table month by month. I now would ...
1
vote
1answer
86 views

How can I create a database where entries are compressed files searchable by index? [closed]

I am trying to design a database solution for logging where the search indices are dates (days), and the values are zipped files. I am doing this because the sheer number of logs I am processing is ...
1
vote
2answers
2k views

Compressing partition - what about index?

To save space on disk I want to compress some partitions of my tables: alter table TEST_TAB move partition TEST_TAB_2014 compress for all operations; I have also indexes on this partition. Should I ...
4
votes
1answer
851 views

GZipStream/DeflateStream compressions alternatives

I have created a simple CLR functions for compressing/decompressing NVARCHAR columns: [SqlFunction(DataAccess = DataAccessKind.None, IsDeterministic = true)] public static SqlBinary Compress( string ...
0
votes
1answer
45 views

Will canceling InnoDB compression that's already in progress corrupt data?

I have a 155GB table that is in the process of being compressed. ALTER TABLE $table_name ROW_FORMAT=COMPRESSED KEY_BLOCK_SIZE=8; This compression has been running for a long time and is impeding my ...
0
votes
1answer
344 views

Correct place to put very large text field for mysql/mariadb

I have an app where a queue is being processed, Each time an entry is processed the result is stuck in a separate table. The queue table gets inserts and updates, the result table inserts only. The ...
6
votes
1answer
2k views

Benefits of Barracuda and Compression

I've been reading about MySQL's file formats Antelope and Barracuda a while ago, and I wonder if I could benefit with having Barracuda and Compression. My server is currently using Antelope, as it is ...
5
votes
1answer
1k views

ROW_FORMAT - COMPRESSED vs COMPACT vs DYNAMIC

In MySQL InnoDB, what is the difference between COMPRESSED, COMPACT and DYNAMIC for ROW_FORMAT? What are the benefits between each other?
3
votes
1answer
72 views

Moving Clustered Index to new filegroup results in excessive filegrowth

I've Moved the clustered index on large tables to new filegroups to defrag, compress, and to recover space more easily from the original "primary" filegroup. Problem: A 315GB compressed Clustered ...
2
votes
1answer
125 views

Best Practice in storage allocation for compressed and partitioned tables

I have a fairly large database that basically consists of one table, this table is paritioned by month and all partitions are compressed with page compression. After the initial load of the data there ...
0
votes
1answer
137 views

pg_basebackup: could not set compression level -1

When trying to run pg_basebackup I received the following error message: pg_basebackup: could not set compression level -1 (null) using the -z option. I received a similar error message when trying ...
4
votes
2answers
66 views

Determining the tables and impact of a large number of SPs

I'm trying to track down what is causing some response times to increase when data is compressed by page compression, when the system is not CPU bound and 95% of responses see a decrease in response ...
2
votes
2answers
1k views

Restoring database from a server that uses data compression

In our environment our production server is using MS SQL Server 2008 Enterprise Edition. We have a development and test server that runs MS SQL Server Standard Edition and the table structure between ...
1
vote
1answer
237 views

Impact of replication compression & encryption on performance, traffic?

What is the impact of MySQL compressed-slave-protocol on replication traffic? According to High performance MySQL it can lower the traffic to a third of the same replication without the compression. ...
1
vote
1answer
3k views

Compressing Base64 Encoded Image in Database Field. Table Size too Large

Database Info Database Type - Percona MySQL. Table engine - InnoDB. I have a database table that is currently using 17GB at 400,000 rows. This size is mainly because I'm storing a 40kb base64 ...
2
votes
1answer
462 views

Does Windows Server File Compression slow Oracle DB performance?

I'm starting a new a new contract and I get to troubleshoot their Oracle instance... I'm more apps and sql, but I'll be trying to figure out their crashes and slow performance. Go figure. I can ...
1
vote
2answers
590 views

T-SQL script to perform a compressed backup with maximum compression level [duplicate]

I have a database with full backup of almost 2GB. When I perform a full backup (without compression) and then compress it with winrar it become 140MB, but when I backup WITH COMPRESSION syntax the ...
5
votes
2answers
1k views

TokuDB optimize table does not reclaim disk space

Was running an optimize table command against one of my tables about 11Gig in size, surprisingly used disk space grew by 2Gig immediately after optimization process finished. I would expect the ...
2
votes
1answer
193 views

Are string columns with very few different entries automatically compressed?

We have a table which contains a column with only a dozen different strings in it. Is there anything I need to do in order to get the DB to compress this information? We don't have too much disk space ...
2
votes
1answer
1k views

SQL Server 2012 Page Compression - Determine compression ratio?

We're using SQL Server 2012 and have page compression turned on for a number of our larger tables. Is there a way we can determine the compression ratio we're getting? We'd like to be able to ...