Questions tagged [storage]

For questions about the persistent storage of database data.

Filter by
Sorted by
Tagged with
1
vote
0answers
59 views

What parameters should I use to measure storage I/O capabilities

I want to measure the throughput of my disk subsystem using: https://gallery.technet.microsoft.com/DiskSpd-a-robust-storage-6cd2f223 what parameters should I use to closely emulate SQL I/O? Is there ...
1
vote
0answers
238 views

Why ndb data memory is 94% if i m using disk storage cluster

I have following structure 2 data node 1 management node 2 sql node i have create one log file of initial size 200M then created table space and added 3 data file data1.dat (initial size: 10GB) ...
2
votes
1answer
2k views

How do I increase the storage available for a SQL Server instance on AWS RDS?

The Amazon docs state that you cannot increase the storage allocated to a SQL Server RDS instance: Note that you cannot change the storage capacity nor the type of storage for a SQL Server DB ...
1
vote
1answer
225 views

How calculate per tenant disk usage in a multitenant database with tenant_id columns in postgresql

I am using Django and postgres for a multi-tenant webapp. We have around 100 tables and each table has a tenant_id column, identifying the tenant of that particular row. I need a solution that would ...
0
votes
1answer
86 views

How PostgresSQL stores duplicated VARCHAR values in a column

I have a VARCHAR(255) column in a table with about 50 million rows. In that column there is only 10 unique values, which act as labels. I'm wondering whether Postgres does something smart and stores ...
1
vote
1answer
333 views

NVMe+bcache as huge storage cache for vertica database

We are in process of selecting hardware for 3 machines vertica cluster capable to serve 20-30TB of data (15TB compressed). This translates to 8TB of post-RAID storage. With 16 CPU cores, the storage ...
0
votes
1answer
40 views

Searching for scalable storage solution

In one project I save statuses of processing in MySQL table: `id` `name` `email` `has_apples` `has_bananas` 1 Bob a@b.c 1 0 2 Mike c@d.e 0 1 3 ...
0
votes
2answers
43 views

Storing meta about a cropped photo [closed]

Want to know how to save cropped images in the database? The info about the images or reference to the cropped images in itself? Working on a marketplace for artists where artists can upload their ...
2
votes
2answers
129 views

What is the most efficient way to store a bunch of empty fields, and ones with only a few choices?

When I say efficient, I mean total storage(kb), and not excessively burdening the CPU. I have 70 columns of data. The last 35 fields have always been NULL. The table has only 4 columns of ...
0
votes
2answers
94 views

How to install MongoDB database as a service in ESxi?

I want to know is it possible to install mongodb directly to the ESXi without guest OS? Please tell me how to setup Data storage as a service environment inside ESXi.
1
vote
1answer
602 views

Can we use VMDK for FCI on SQL Servers?

Can I share a VMDK among 2 nodes for an active passive setup for a SQL Server Failover Cluster setup? Most of the articles I see mention to use RDM's, however we use Veeam backup for the environment ...
1
vote
1answer
794 views

Allocation Size for Backup disk on SQL Server

What would be the optimal allocation size for a backup disk for SQL Server? We have a 2014 instance which was using Veeam backups till recently, but we decided to switch to local backups again for ...
0
votes
1answer
3k views

move AG database files between disks

Environment: SQL 2016 SP1, AG with 2 replicas, sync commit, no readable secondary. 1 file in the PRIMARY FG, 1 for the index FG. Problem: How to move the files for a database in this AG, from the ...
2
votes
0answers
101 views

RethinkDB storage calculations

I am trying to estimate storage requirements for the data our application will store. After doing some research I can pull out data from the stats table. However, I don't understand how those numbers ...
9
votes
2answers
2k views

How exactly does the one-byte “char” type work in PostgreSQL?

I often see people talking about "char". I've never used it. It's defined in the docs as, The type "char" (note the quotes) is different from char(1) in that it only uses one byte of storage. It is ...
1
vote
1answer
92 views

Shared logarch across multipe db2 HADR instances

Background We are looking into building a multiple standby hadr cluster. The Auxiliary standby is in a geographically separate location. from Developer works In a multiple standby system, the ...
13
votes
4answers
9k views

Drives vs. Mount Points?

The previous Senior DBA set up mount points for all of our drives across every SQL Server throughout the company. The new Senior DBA is horrified by mount points wants to change our standard (mainly, ...
1
vote
1answer
97 views

Remove Local RAID Drive from MS SQL Windows Cluster

We recently stood up a production SQL Server 2014 Enterprise on a two-node Windows Failover cluster (Active/Passive). We had some SSD's laying around and decided to use them for the tempdb for one of ...
1
vote
1answer
64 views

Windows Clustering and SQL Availability Groups

I am new to Clustering and Availability groups. I am creating a 4 node Windows 2012 Cluster with SQL 2016 enterprise. SQL will not be clustered we are just using the availability group option. The ...
2
votes
2answers
353 views

Best Way To Migrate Existing Production Database To New Physical Storage Structure

I have recently taken a job as a Senior Database Administrator at a small but rapidly growing company. My first order of business was a clean up the logical design of the main database (adding primary ...
1
vote
1answer
622 views

Best practice for storing large files (+1GB each) [closed]

I am looking to build a big data platform for weather forecasting. I will be using a numerical model known as WRF which takes in GFS files and produces files which can be over 1GB each. I will be ...
0
votes
1answer
476 views

Identify Full Text Catalog Files

I'm trying to write a query for a report to show how much free space is in our data files so we can plan storage for the future. I'm pulling data out of sys.database_files, and I can narrow it down to ...
6
votes
2answers
1k views

Seperate volumes for tempdb, data, and backups on SQL Servers in VMs

When configuring new SQL Servers on VMs, it is a good idea to have the Database, TempDB, logs, and backups on separate logical drives, even if the underlying storage is the same? I know that this is a ...
0
votes
1answer
477 views

JSON storage requirements for MySQL

I could not find storage requirements for JSON type columns in MySQL documentation How much storage space allocated for JSON type column in InnoDB? Are JSON columns the same as BLOB?
0
votes
1answer
80 views

Storage does not failover in Windows cluster

I created a lab setup for a 2 node cluster using Windows 2012 R2. I first configured the quorum and performed a failover between both the nodes, the quorum would also map to the respective node. But ...
21
votes
2answers
10k views

How to store one-byte integer in PostgreSQL?

In PostgreSQL documentation, it is said that integer data types can be stored in either two-, four- or eight-byte space. One of the columns of a table in my database contains a one-byte integer value ...
0
votes
1answer
42 views

Alwayson + FCI with independent Storage

I have setup with FCI+AG solution but with independent disks. There is no listener, and the applications are connecting to the FCI. Is this setup even reasonable to use? The only option I see here is ...
2
votes
3answers
109 views

Why does imported txt table consume so much space

I have a .txt file with storage size 1253 MB. After importing it to SQL Server 2016, the table takes 1680 MB on disk. Why does the storage space grow so much? I didn't do any data transformation and ...
0
votes
1answer
4k views

Measuring IOPS in SQL 2014

We have a LANDEsk migration going on where several servers are being consolidated into one SQL 2014 Cluster. What would be the best way to calculate IOPS for such a scenario? The data is still being ...
0
votes
2answers
388 views

Postgres Database too large to start service

Due to some craziness on a server I am looking after, I have a huge database that needs to be truncated (44GB despite being a simple site). However, I can't start the postgres service as there is not ...
4
votes
2answers
546 views

Capacity planning for SQL Server consolidation

My company has a small SQL environment for LANDesk and they want to migrate all the servers to a single SQL cluster per region. What I want to know is, how do I determine the capacity for such a ...
1
vote
1answer
60 views

Precautions for moving a SQL cluster from an old to a new datastore

My storage team wants to move a SQL cluster (2 node VM) from an old data store to Storage vMotion . What are the precautions I can take before this exercise is performed? I am planning to take ...
2
votes
1answer
504 views

How to get space used by In-Memory table in SqlServer

I'm trying to understand how much storage In-Memory table consumes in SqlServer: SELECT is_memory_optimized,durability_desc FROM sys.tables WHERE name='TBL_HSD_AD_OR' select count(*) [#Rows] from ...
0
votes
1answer
1k views

DBPATH, LOGPATH and STORAGEPATH

Assuming that there are only two available paths, say /log and /data. Would it be better to set DBPATH to /log or /data. I.e. CREATE DATABASE WHATEVER AUTOMATIC STORAGE YES ON /data DBPATH ON /log; ...
2
votes
1answer
364 views

How to estimate the storage needed for a database?

I ran across this questions trying to dive into a computer measurements worksheet online and for the life of me could not figure it out. This is the question: Assume each record in a database ...
2
votes
1answer
73 views

Data from different tables into one table

I've requirement where I need to store information from different sources in my system and the process that data. When I say from different sources it will be completely different table structure from ...
4
votes
2answers
8k views

Azuredb The database 'tempdb' has reached its size quota

We are runnig a V12 Azure Database instance on the S3 tier. There is still about 100GB of a free space on the database. When loading 85MB XML file with SSIS running on a different non azure SQL server,...
-1
votes
2answers
1k views

How can I estimate the size of a new table?

We have tables with a lot of data (50M new rows each month, just in one table). Now I want to know what would be the impact of adding a new column to those tables, or creating a new table. Something ...
0
votes
1answer
765 views

DB2 9.7 - how to release unused space back to the OS?

I am looking for a clear set of instructions on how to release unused space back to the operating system from a DB2 9.7 instance running on a Windows box. IBM's docs might be great if you already ...
2
votes
1answer
51 views

Simplified table using more disk space than its original (bigger) version

Using PostgreSQL 9.3 on Debian 7. I have a system that searches for text tokens inside PDF files and store where it was found for indexation. Basically the table structure is: ...
2
votes
0answers
448 views

What is the storage size of a BIT (8) NULL column, and is it any different than BIT (7) or BIT (8) NOT NULL?

According to this question and the docs, the storage requirements for a BIT (M) field in MySQL are "approximately (M+7)/8 bytes". This seems awfully vague, and the answers given there don't specify ...
1
vote
0answers
616 views

What to choose for SQL Server storage - RAID 5 with 15K drives or RAID 10 with 10K drives

Im looking to configure a new sql server with a dell r730xd 24 bay chassis and need some help with choosing the drive configuration for sql server. Need help on what to choose for our RAID ...
0
votes
0answers
415 views

Diskspd and high latency

Hope someone can help here. I am trying to understand the high latency reported by Diskspd. Please help how to investigate this further. OS : Windows server 2008 Local disk, Not SAN or NAS RAID :...
10
votes
1answer
3k views

Impact of CLUSTER on performance

I'm trying to optimize my Postgres 9.2 database to speed up queries with date restrictions. I have a timestamp column, but mostly I'm asking for some day, so I have created an index with timestamp to ...
0
votes
2answers
459 views

SQL Server Storage for multiple data files

Recently, our company wants to add 4TB on the drive size for SQL Server. We have two drives now which have different size and data files. In order to make sure our SQL Server has the best performance, ...
5
votes
1answer
806 views

SQL query fills up RDS free storage space after upgrade to MySQL 5.7

After the upgrade to MySQL 5.7 the execution of a SQL query fills up the free storage space. The upgrade was performed through the AWS console, selecting the automatic procedure to upgrade the RDS ...
6
votes
2answers
21k views

Choosing the right storage block size for sql server

There are many articles on what storage blocks size should be used for sql server e.g. Disk Partition Alignment Best Practices for SQL Server. The right blocks size should improve the performance of a ...
1
vote
3answers
4k views

SQL Server engine in one place with database files on NAS

My office uses accountant programs which run on SQL Server 2008 R2. The SQL Server engine must be installed on one of the laptops (called "server") and the other laptops (called "clients") connect to ...
0
votes
1answer
1k views

MySQL read-write Master with many read-only Slaves over shared storage?

I've asked the same question on the MySQL forum but have also seen lots of great responses here as well so thought I would try my luck here too. We have a relatively large MySQL environment where we ...
6
votes
1answer
3k views

SQL Server on SAN, same LUN: one logical drive vs multiple

First, let me start by saying that I did notice there are multiple similar questions to this, but neither of them is exactly what I want to ask, and not one of them has a definite answer. Second, let ...