Questions tagged [storage]
For questions about the persistent storage of database data.
300
questions
-1
votes
1
answer
32
views
How can I limit storage space taken up by `wpr_bucket_table`?
TL;DR: What is the wpr_bucket_table object in a SQL Server database, and how can we reduce the space it takes up?
We have an Azure SQL Database that takes up significantly more storage than expected. ...
- 1
0
votes
1
answer
25
views
Reliable database server solutions for industrial mini PCs
Although my issue may lean more toward hardware, I hope someone can help me with a solution to the issue I am experiencing.
I manage a series of industrial PCs that run a standalone MySQL server on ...
- 1
-1
votes
1
answer
20
views
What is a common type of storage hardware for dedicated MySQL servers?
I am curious what kind of storage hardware is common to see in servers that are dedicated for MySQL ? For example online services like Amazon AWS, Azure, Google, etc that offer(ed) dedicated mysql ...
- 153
0
votes
1
answer
22
views
Same data stored in more rows with more repetition results in smaller SQLITE file?
I'm comparing two very barebones SQLite databases with the same data stored differently.
Database A has tables like this:
string (TEXT UNIQUE)
count_1 (INTEGER)
count_2 (INTEGER)
the
23
10
it
56
44
...
- 13
0
votes
1
answer
50
views
Using GPT partition type with SQL Server in production?
We are currently using MBR partition type with our SQL Server in production, but as our data volume increases, we are facing issues with our data drives getting full. We can't extend them because they ...
- 897
1
vote
0
answers
25
views
Structuring an N-Gram-counts-over-time database
I’m working on an application similar to the Google Ngram viewer, tracking the occurrence of terms in articles from different news publications over time.
In the past I’ve worked primarily on front-...
- 13
0
votes
1
answer
40
views
How to tell if a MySQL query speed is bottlenecked by storage or CPU speed?
Using MySQL 8.0.30 on Rocky Linux 9
For slow MySQL queries in general, not for a speciffic one, is there a way to tell if query speed was bottlenecked by storage speed, cpu speed, or maybe even ram ...
- 153
0
votes
1
answer
74
views
How to remove unallocated space after partitioning
I've recently done partitioning on a table (postcode column) and created new filegroups for each postcode.
Now that it is no longer using the PRIMARY filegroup, the file size is still as it is. How do ...
0
votes
1
answer
45
views
Most generic filter class model
I'm designing an application that retrieves data from a (currently simple) .csv file and stores it's raw content.
The application is intended to offer the user the possibility to define filters on the ...
2
votes
2
answers
226
views
Is space reserved for a field when data doesn't use the full length?
A column is marked as nvarchar(50), but the value stored is only two characters. Do the remaining 48 characters take up space?
- 29
1
vote
0
answers
69
views
How To Transfer Postgres Data That Doesn't Have a .s.PGSQL.5432 Socket or /var/lib/pg_data Mount?
The End Goal
To somehow combat the issues listed so I can transfer stored data from the old database node (that has an improper postgres mount) to the new one that is currently bringing in new data (...
- 11
0
votes
0
answers
176
views
PostgreSQL 12 with NFS storage, recommended wal_sync_method value
We use PostgreSQL 12 running in Docker container. The storage for the data directory is mounted over NFS. Recently, we have had an issue where Liquibase database lock table had two rows (typically it ...
- 123
4
votes
1
answer
502
views
Disable TOAST compression for all columns
I am running PostgreSQL on compressed ZFS file system. One tip mentioned is to disable PostgreSQL's inline TOAST compression because ZFS can compress data better. This can be done by setting column ...
- 289
0
votes
0
answers
47
views
move specific MariaDB database to custom folder?
How can I move a specific MariaDB database to a custom folder? I'm not talking about changing the datadir or moving all databases, just a specific one?
I have myawesomedb on a MariaDB 10.6 server on ...
- 103
1
vote
1
answer
751
views
Storage space used for NULL values
According to below links, NULL values take some storage space:
https://stackoverflow.com/questions/3731172/how-much-size-null-value-takes-in-sql-server
https://www.sqlservercentral.com/forums/topic/...
- 5,144
1
vote
2
answers
75
views
Could MySQL perform better on a 10GB network storage with raid vs local HDD?
Compared to using a HDD on local computer and do many MySQL read / writes on it, could it have more queries per second if I install 10GBe network cards and I store the MySQL data on a raid network ...
- 153
0
votes
1
answer
252
views
Table with smaller data types seems to take more space on disk?
I have these two identical tables:
Table "public.region"
Column | Type | Collation | Nullable | Default
-------------+----------+-----------+----------+---------
...
- 225
1
vote
1
answer
736
views
More columns vs. more rows to optimize storage and performance?
I have a table with this structure:
ticker VARCHAR NOT NULL,
interval VARCHAR NOT NULL,
ts TIMESTAMP WITHOUT TIME ZONE NOT NULL,
price ...
- 261
0
votes
1
answer
65
views
Primary File Organization in DBMS - Files of ordered records (sorted files)
"Fundamental of Database Systems", 3rd ed. by Elmasri and Navathe, page 136 says:
"We can physically order the records of a file on disk based on the values of one of their fields [...]&...
- 33
4
votes
1
answer
764
views
Microsoft SQL server storage best practice on Windows server vm with hybrid storage
I have a windows server VM, with a combination of HDD and SSD storage, the SSD storage capacity is limited to 50 GB, but HDD storage capacity is high.
What is the best way to share these storages to ...
- 251
0
votes
0
answers
378
views
Why JSON indexing take less storage than multiple columns in MySQL 8?
I am doing a quick performance comparison for 10 000 rows on MySQL 8.0.27 between
a table multiple_cols with 2 columns num INT and str CHAR(200) having each an index,
a table json_indexing with 1 ...
- 101
1
vote
2
answers
284
views
Determine Ideal Collation Set for correct data storage
Alright so I have a MariaDB DB and I've just noticed some weird storage issues, like the following:
My JSON columns (which in MariaDB are LONGTEXT) have an automatically set collation of utf8mb4_bin. ...
- 161
0
votes
2
answers
1k
views
Size of data in DB is much larger than size of data dumped to disk
I have a table that contains 99.9% of the data in the database. When I query the size of the table and database, I get:
mydb=# SELECT pg_size_pretty( pg_database_size('mydb') );
pg_size_pretty
------...
- 141
1
vote
1
answer
124
views
Performance of temp db files on SAN
It is generally recommended to put the tempdb database on disks that differ from those that are used by user databases.
I have 4 databases on my sql server, ranging from 5GB to 300GB in size.
D: drive ...
- 3,153
6
votes
1
answer
515
views
Are TOAST rows written for UPDATEs not changing the TOASTable column?
Imagine I have a table in Postgres 13 like this:
CREATE TABLE public.people (
id integer PRIMARY KEY,
full_name character varying(255),
bio text
);
I then insert a row with enough ...
- 281
0
votes
0
answers
700
views
Oracle Storage Full, How to release space?
i have and AWS RDS Oracle Database wich its storage is full, looks like the cause is SYSAUX tablespace with 10.2GB size
The largest object inside SYSAUX is: WRI$_ADV_OBJECTS (TABLE) checking the table ...
0
votes
1
answer
285
views
How to reduce big size database files (Data File ) SQL Server without SHRINK?
I found a couple of 'question' regarding shrinking big datafiles but I think that is not very accurate to my situation. So here is my question
I have a big database with almost 8TB of Data File Size ...
- 13
-1
votes
1
answer
33
views
I want to drop existing table space and add the freed space to the new table space in oracle
I want to drop existing table space and add the freed space to the new table space in oracle.
I am trying drop an existing tablespace on oracle db, and then use the freed space for a new table space. ...
- 1
0
votes
0
answers
1k
views
What are the differences between Heap File Organization and Sequential File Organization (Pile Method)
I was learning about File Organization in DBMS, but i found that the Heap File Organization and Sequential File Organization (Pile Method) have the same definition (or maybe i couldn't find any ...
0
votes
2
answers
119
views
How to store a table with 1000+ columns, which are mostly null
Today I have to restart a projet and due to a specificity of the business (real estate), I will have to store a table for house/apartment/hangar/wahetever. But a single row can contain more than 1000 ...
SKMTH
0
votes
1
answer
398
views
Postgres Database flagged as STORAGE FULL whereas there's 45 Gb available
I will start this post by stating that I am not very experienced in database administration, please accept my apologies for any unclear explanation you may find below.
We have a replica postgresql ...
0
votes
1
answer
40
views
Character type for a column with expected natural duplicates?
I've noticed that some non-relational databases (e.g. Druid) have a feature where if a given string is stored in multiple rows, the physical storage keeps only a single copy (per some unit of storage)....
- 289
0
votes
1
answer
69
views
Storage configuration for faster queries [closed]
Please advise on setting up storage allocation for a new SQL Server 2019 machine.
Ryzen 7 8Core with 64GB Ram
4 local drives (2TBNVMe PCIe4 + 1TBNVMe PCIe3 + 2TBSSD + 4TBHDD)
I am going to allocate ...
- 11
0
votes
3
answers
261
views
RMAN configuration suggestions to help save our storage space?
To preface...
Our Senior Oracle DBA has just recently passed away, and I've been taking over. My level of experience is just a junior level. So there is a lot I still don't understand. So I appreciate ...
- 11
3
votes
2
answers
1k
views
Why database has char data type when varchar is more efficient?
I understand the basic difference between CHAR and VARCHAR datatype that CHAR takes up fixed length whereas VARCHAR takes up space based on the content being stored.
But if VARCHAR is so efficient in ...
- 133
1
vote
2
answers
41
views
What steps we need to perform from DB end in case of storage migration?
What are the impacts / steps from DB2 DB side before VMware SvMotion Storage migration ?
- 11
1
vote
1
answer
65
views
Pointing the database secondary data file towards a network drive
I have a 2 TB database and the Data Drive has filled up. My network team cannot expand the drive nor provide another drive so that the secondary data file can be pointed towards that. My question is ...
- 1,019
4
votes
3
answers
2k
views
SQL Server - Benefits of splitting databases across different logical drives
We're about to start a project to migrate a large DWH to new physical servers in a new data centre. The current server spec is SQL Server Enterprise 2016 SP2 running on Windows 2012 R2. The new ...
- 326
1
vote
1
answer
2k
views
Azure Virtual Machine - local temp storage (D: drive) - how much IOPS it can handle?
Virtual machine size DS3 (under older generation sizes)
Azure Portal (when deploying VM) shows that DS3 supports up to 16 data disks / up to 12800 IOPS - thats fine,
But what I am interested in is it'...
- 5,144
1
vote
2
answers
2k
views
SQL Database size incorrect and database file growing while empty
RESOLVED - SOLUTION AT BOTTOM OF POST
PROBLEM
I have a database data file showing as 200GB on disk, and 200GB allocated space in the database properties. sp_spaceused also shows 200GB allocated. All ...
0
votes
1
answer
241
views
SQL Server storage - evaluate the number and types of read write operations for the existing deployment
Training for SQL Server, one of the questions in Learning material says:
Before migrating on-premise SQL Server deployment (single server) to Azure VM, you need to evaluate "number and types of ...
- 5,144
0
votes
1
answer
405
views
ORACLE ASM present one or more LUNs?
I have the following question regarding the allocation of disks or LUNs to ASM in Oracle, specifically, I have an Oracle 18c DB in Cluster and I have created several diskgroups, now, I need to ...
- 137
0
votes
1
answer
469
views
How do you change the storage parameters of a already made table (sql developer)?
Summarize the problem
I have been given 6 tables that have all been created already and I was told to change the storage parameters of those tables. the issue I run into is that I can only change ...
- 107
0
votes
1
answer
128
views
Issues (Other Than Disk Space) For Using Operating System Partition
Other than accidentally filling your entire C:\ drive with data, are there any other considerations for using the OS drive for data files? Most answers are simply "don't do it", but I'd ...
- 103
1
vote
0
answers
730
views
SQL Server placement of Files SAS SSD vs SAS HDD
I've got a new server which will host MS SQL Server Virtual Machine along with Other VMs on HyperV. SQL Server will account for most(70%) of the Load.
The server has below Storage:
a. 2 x 240GB Read ...
- 111
1
vote
0
answers
45
views
SQL Server & Storage Question - What's the right choice? [duplicate]
I am a young DBA from Germany and I am the administrator for our customers SQL Servers.
I have a question and I really hope that I can explain this in English words. 😃
At the moment I am reading ...
0
votes
1
answer
139
views
What is the point of encryption at rest?
I am wondering what is the point of encryption at rest?
It is said that a hacker cannot steal the database and look through it. I'm afraid that it does not protect the database while the key is stored ...
- 23
5
votes
1
answer
7k
views
Best practices for SQL Server block size while formatting disks for data and log files
What is the current best practice or general guidance on formatting the filesystem for SQL server database files.
Currently we have SQL Server file system, NTFS formatted with 64KB block size based on ...
- 2,149
0
votes
1
answer
2k
views
TempDB Log File Growth - questions
Problem:
On one of the production boxes, TempDB transaction LOG file grew unexpectedly, filling the drive
It was 32 GB but now it is 240 GB
Questions:
What is the mechanism of TempDB log file usage ?
...
- 5,144
1
vote
2
answers
4k
views
varchar(n) size?
When I use varchar(5) in a INSERT query it means that the attribute in the table will take exactly 5 bytes in memory? (Given that one printable character takes one byte)?
- 35