Questions tagged [storage]
For questions about the persistent storage of database data.
300
questions
1
vote
1
answer
158
views
Remove Local RAID Drive from MS SQL Windows Cluster
We recently stood up a production SQL Server 2014 Enterprise on a two-node Windows Failover cluster (Active/Passive). We had some SSD's laying around and decided to use them for the tempdb for one of ...
- 11
1
vote
1
answer
80
views
Windows Clustering and SQL Availability Groups
I am new to Clustering and Availability groups. I am creating a 4 node Windows 2012 Cluster with SQL 2016 enterprise. SQL will not be clustered we are just using the availability group option. The ...
- 51
2
votes
2
answers
413
views
Best Way To Migrate Existing Production Database To New Physical Storage Structure
I have recently taken a job as a Senior Database Administrator at a small but rapidly growing company. My first order of business was a clean up the logical design of the main database (adding primary ...
- 515
1
vote
1
answer
686
views
Best practice for storing large files (+1GB each) [closed]
I am looking to build a big data platform for weather forecasting. I will be using a numerical model known as WRF which takes in GFS files and produces files which can be over 1GB each.
I will be ...
- 181
0
votes
1
answer
577
views
Identify Full Text Catalog Files
I'm trying to write a query for a report to show how much free space is in our data files so we can plan storage for the future. I'm pulling data out of sys.database_files, and I can narrow it down to ...
- 3,202
6
votes
2
answers
1k
views
Seperate volumes for tempdb, data, and backups on SQL Servers in VMs
When configuring new SQL Servers on VMs, it is a good idea to have the Database, TempDB, logs, and backups on separate logical drives, even if the underlying storage is the same? I know that this is a ...
- 625
0
votes
1
answer
581
views
JSON storage requirements for MySQL
I could not find storage requirements for JSON type columns in MySQL documentation
How much storage space allocated for JSON type column in InnoDB? Are JSON columns the same as BLOB?
- 101
0
votes
1
answer
89
views
Storage does not failover in Windows cluster
I created a lab setup for a 2 node cluster using Windows 2012 R2. I first configured the quorum and performed a failover between both the nodes, the quorum would also map to the respective node. But ...
- 625
31
votes
2
answers
16k
views
How to store one-byte integer in PostgreSQL?
In PostgreSQL documentation, it is said that integer data types can be stored in either two-, four- or eight-byte space. One of the columns of a table in my database contains a one-byte integer value ...
- 741
0
votes
1
answer
49
views
Alwayson + FCI with independent Storage
I have setup with FCI+AG solution but with independent disks. There is no listener, and the applications are connecting to the FCI. Is this setup even reasonable to use? The only option I see here is ...
- 625
2
votes
3
answers
121
views
Why does imported txt table consume so much space
I have a .txt file with storage size 1253 MB. After importing it to SQL Server 2016, the table takes 1680 MB on disk. Why does the storage space grow so much?
I didn't do any data transformation and ...
- 693
0
votes
1
answer
4k
views
Measuring IOPS in SQL 2014
We have a LANDEsk migration going on where several servers are being consolidated into one SQL 2014 Cluster. What would be the best way to calculate IOPS for such a scenario? The data is still being ...
- 625
0
votes
2
answers
498
views
Postgres Database too large to start service
Due to some craziness on a server I am looking after, I have a huge database that needs to be truncated (44GB despite being a simple site). However, I can't start the postgres service as there is not ...
- 103
4
votes
2
answers
592
views
Capacity planning for SQL Server consolidation
My company has a small SQL environment for LANDesk and they want to migrate all the servers to a single SQL cluster per region. What I want to know is, how do I determine the capacity for such a ...
- 625
1
vote
1
answer
69
views
Precautions for moving a SQL cluster from an old to a new datastore
My storage team wants to move a SQL cluster (2 node VM) from an old data store to Storage vMotion . What are the precautions I can take before this exercise is performed? I am planning to take ...
- 625
2
votes
1
answer
687
views
How to get space used by In-Memory table in SqlServer
I'm trying to understand how much storage In-Memory table consumes in SqlServer:
SELECT is_memory_optimized,durability_desc FROM sys.tables WHERE name='TBL_HSD_AD_OR'
select count(*) [#Rows] from ...
- 507
1
vote
1
answer
2k
views
DBPATH, LOGPATH and STORAGEPATH
Assuming that there are only two available paths, say /log and /data. Would it be better to set DBPATH to /log or /data. I.e.
CREATE DATABASE WHATEVER
AUTOMATIC STORAGE YES
ON /data DBPATH ON /log;
...
- 22.6k
2
votes
1
answer
474
views
How to estimate the storage needed for a database?
I ran across this questions trying to dive into a computer measurements worksheet online and for the life of me could not figure it out. This is the question:
Assume each record in a database ...
- 21
2
votes
1
answer
144
views
Data from different tables into one table
I've requirement where I need to store information from different sources in my system and the process that data. When I say from different sources it will be completely different table structure from ...
- 21
5
votes
2
answers
12k
views
Azuredb The database 'tempdb' has reached its size quota
We are runnig a V12 Azure Database instance on the S3 tier. There is still about 100GB of a free space on the database. When loading 85MB XML file with SSIS running on a different non azure SQL server,...
- 151
-1
votes
2
answers
1k
views
How can I estimate the size of a new table?
We have tables with a lot of data (50M new rows each month, just in one table).
Now I want to know what would be the impact of adding a new column to those tables, or creating a new table. Something ...
- 109
0
votes
1
answer
992
views
DB2 9.7 - how to release unused space back to the OS?
I am looking for a clear set of instructions on how to release unused space back to the operating system from a DB2 9.7 instance running on a Windows box. IBM's docs might be great if you already ...
- 177
2
votes
1
answer
68
views
Simplified table using more disk space than its original (bigger) version
Using PostgreSQL 9.3 on Debian 7.
I have a system that searches for text tokens inside PDF files and store where it was found for indexation.
Basically the table structure is:
...
2
votes
0
answers
542
views
What is the storage size of a BIT (8) NULL column, and is it any different than BIT (7) or BIT (8) NOT NULL?
According to this question and the docs, the storage requirements for a BIT (M) field in MySQL are "approximately (M+7)/8 bytes". This seems awfully vague, and the answers given there don't specify ...
- 163
1
vote
0
answers
698
views
What to choose for SQL Server storage - RAID 5 with 15K drives or RAID 10 with 10K drives
Im looking to configure a new sql server with a dell r730xd 24 bay chassis and need some help with choosing the drive configuration for sql server. Need help on what to choose for our RAID ...
- 11
0
votes
0
answers
488
views
Diskspd and high latency
Hope someone can help here.
I am trying to understand the high latency reported by Diskspd. Please help how to investigate this further.
OS : Windows server 2008
Local disk, Not SAN or NAS
RAID :...
- 633
11
votes
1
answer
4k
views
Impact of CLUSTER on performance
I'm trying to optimize my Postgres 9.2 database to speed up queries with date restrictions.
I have a timestamp column, but mostly I'm asking for some day, so I have created an index with timestamp to ...
- 263
0
votes
2
answers
537
views
SQL Server Storage for multiple data files
Recently, our company wants to add 4TB on the drive size for SQL Server. We have two drives now which have different size and data files. In order to make sure our SQL Server has the best performance, ...
5
votes
1
answer
1k
views
SQL query fills up RDS free storage space after upgrade to MySQL 5.7
After the upgrade to MySQL 5.7 the execution of a SQL query fills up the free storage space.
The upgrade was performed through the AWS console, selecting the automatic procedure to upgrade the RDS ...
- 51
7
votes
2
answers
28k
views
Choosing the right storage block size for sql server
There are many articles on what storage blocks size should be used for sql server e.g. Disk Partition Alignment Best Practices for SQL Server. The right blocks size should improve the performance of a ...
- 938
1
vote
3
answers
4k
views
SQL Server engine in one place with database files on NAS
My office uses accountant programs which run on SQL Server 2008 R2. The SQL Server engine must be installed on one of the laptops (called "server") and the other laptops (called "clients") connect to ...
- 13
0
votes
1
answer
1k
views
MySQL read-write Master with many read-only Slaves over shared storage?
I've asked the same question on the MySQL forum but have also seen lots of great responses here as well so thought I would try my luck here too.
We have a relatively large MySQL environment where we ...
6
votes
1
answer
3k
views
SQL Server on SAN, same LUN: one logical drive vs multiple
First, let me start by saying that I did notice there are multiple similar questions to this, but neither of them is exactly what I want to ask, and not one of them has a definite answer.
Second, let ...
- 81
1
vote
2
answers
1k
views
Performance improvement by placing tables on a virtual RAM disk
I am trying to improve performance of queries by placing the tables in a virtual RAM DISK. I am using in Oracle 11.2 Standard edition with 4G of SGA and 2G of PGA.
I created a Virtual RAM DISK of ...
- 113
2
votes
2
answers
114
views
IBM FlashSystem V9000 storage - should the os, mdf and ldf and tempdb be separated onto different volumes?
Is there any benefit that justifies separating the os, mdf, ldf and tempdb onto separate volumes?
RAID and redundancy is already included.
Connection options to the host are:
16 x 16/8/4 Gb Fibre ...
- 2,505
0
votes
0
answers
74
views
MySQL Storage Engine and Memory
I recently found out that, the databases does not have standard architecture(data model), some of them are,
No relationship between tables(entities).
No indexes defined.
Only integer and varchar data ...
- 2,144
0
votes
2
answers
369
views
MySQL Backup Strategy
We are running the backup from the replication server and it is working good, since we are not facing any other issues, some information for better understanding our strategy:
Backup Type: Full ...
- 2,144
1
vote
1
answer
2k
views
Error 823 and no connection
One of our servers tells us it has Error 823 issues:
TITLE: Connect to Server
Cannot connect to ServerName.
ADDITIONAL INFORMATION: Warning: Fatal error 823 occurred at Mar 1 2016 >
10:...
- 4,697
3
votes
2
answers
636
views
SAN for SQL Server: One large spindle set for all loads, or discrete by load?
SQL Server 2014, Standard Edition (running under vmware, fwiw).
Adding a Dell MD3420 DAS box.
In the old school, you would set up discrete spindle sets for MDF, LDF, TEMPDB, BACKUP.
E.g.
MDF: Qty ...
1
vote
0
answers
657
views
Storing and searching user location using latest MySQL 5.7 spatial features
I want to use MySQL spatial features to store user location.
I have read about MySQL spatial geometry data type.
According to this article this works very well in MySQL 5.7
http://mysqlserverteam.com/...
- 151
1
vote
1
answer
304
views
Set a Max allocated size for a sellected storage path in db2
I have a DB2 storage group with storage paths set like
C:\
D:\
E:\
Size of my C: drive is 100 GB and the other programs keep crashing because it fill data drive by one, even I can allocate more ...
- 13
1
vote
2
answers
97
views
Which TLogs are causing large block change in SAN snap?
The environment is SQL Server 2014 Enterprise Edition, NetApp storage managed by CommVault Simpana. We have 100 dbs setup on an instance, all TLogs are on the same Volume.
The SAN Admin has setup ...
- 61
0
votes
1
answer
87
views
Perfmon Counters that relate to SQLIO
I am trying to benchmark a new virtual SQL server. this will be the first time I have virtualized a production SQL server. I don't think this is a supper busy server. 100-200 users, of varying ...
0
votes
1
answer
398
views
SMB 3.0 file share storage limitation
What is/are the limitation/s to move from SAN storage to SMB 3.0 on windows Server 2012 - SQL server 2012 enterprise production environment?
I want to know the benefit of using SAN over SMB 3.0 as ...
- 55
8
votes
2
answers
18k
views
PostgreSQL data files have size more than data itself
We have a system that does some data archiving to a PostgreSQL DB. We found out that the PC storage was full due to the DB archiving. The problem is that I checked the data files residing in /var/lib/...
- 229
1
vote
1
answer
79
views
How to determine how much storage to store backups?
I was thinking about this question ( Here where I work, we have a lot of space so backups are dayli ok ), and i'm thinking about if I was hired in another company, and see that they don't have backups,...
- 7,248
1
vote
1
answer
192
views
Is there a way to specify the initial size of MySQL File-Per-Table Tablespaces?
Preparing for massive data import into a MySQL 5.7 community instance, I'd like to know if there is a way to allocate upfront the total amount of space that will be used by the volume of information?
...
- 294
2
votes
3
answers
571
views
Discover available HD storage from inside SQL Server
I have a SQL Server 2012 instance hosted in a VPS. I can't login on VPS's Windows directly. I know that there are multiple instances installed on that VPS.
I have a query that shows me each DB's file ...
- 1,473
1
vote
0
answers
620
views
SQL Server index rebuild cause database growth
I have a 80GB database with about 20GB of indices size. Whenever I build the indices online the database file will grow to gain 20GB of unallocated space, and if the unallocated space is less than ...
- 81
4
votes
1
answer
339
views
Would SQL in a cluster failover when transaction log for database is full?
I have a Microsoft SQL Cluster with one instance. If one of the databases is full, would SQL in a cluster failover when transaction log for database is full?
If it depends on the reason the ...
- 285