Questions tagged [storage]

For questions about the persistent storage of database data.

Filter by
Sorted by
Tagged with
1
vote
0answers
13 views

How to calcuate current IOPS consumed in AWS

We have a SQL Server hosted on AWS using EC2 and EBS. SQL Files are hosted on EBS. EBS vol type is GP2 and drive IOPS is 480. At an instance of time Write Througput in AWS is showing is 725 and Read ...
0
votes
1answer
23 views

Why VolumeQueueLength goes high for SQL Server in AWS

We have one SQL Server hosted on AWS EC2 machine. In the monitoring tab of one of the volume, we are seeing that VolumeQueueLength is periodically reaching to around 32 and then coming back. So ...
0
votes
0answers
45 views

MySQL Large History list length & Storage Space

Currently, my MariaDB database server is running out of space, hence I am trying to delete old records (using multiple threads with DELETE FROM tbl WHERE index > ? and index < ?). My ...
0
votes
0answers
15 views

how many IOPS sql server is performing currently on the underlying storage system

How can we know how many IOPS sql server is performing currently on the underlying storage system? Which perfmon counter will give us above details? Is it equal to: Logical Disk: Disk Read/Sec + ...
1
vote
1answer
36 views

Cannot take backup into NAS storage at specific time

I have a job which runs every 30 minute and takes t-log backup of the database suing Ola's script. Every Thursday and Friday at 22:45 I get an error: 11/07/2019 22:45:00,Backup,Unknown,Error: 3041<...
0
votes
0answers
27 views

ReFS on SQL Servers 2016 and 2017 [duplicate]

Could you please share your experience regarding ReFS for SQL Server's storage: Is it better to use ReFS for SQL server 2016 upward? Have you come across any issues with ReFS? Does it recommend for ...
0
votes
0answers
89 views

Which MySQL settings are the closest equivalent to RDS' “Queue depth”?

I'm trying to find out which MySQL status variables can be used to get as close as possible to the RDS value of "Queue depth". On a test system, I reckon that %pending% variables may be at least a ...
0
votes
0answers
11 views

Storage technique used in meet in the middle attacks

When a block cypher is used twice in a row, it can be broken in 2^{k+1} key searches (k denotes the number of bits used in key). This computational advantage comes at a price of storing 2^k pairs of ...
0
votes
1answer
18 views

MySQL datafiles on SMB3 network storage

We have MySQL-server on Ubuntu with InnoDB-datafiles on a local disk. As part of an upgrade program, the company is planning to put the datafiles on a Windows fileserver where they can be mounted with ...
0
votes
1answer
38 views

How to grant xp_delete_file to non-sysadmin login?

I want to delete old backups from shared folder, which are located on separate NAS storage, using newly created SQL login. Is there any workaround to execute xp_delete_file using another account which ...
1
vote
1answer
48 views

Physical co-clustering of two or more logical relations/tables in modern RDBMS

One possible approach to optimize search queries is (a) to store the records that retain data that corresponds to different relations/tables in (b) the same file → on the same pages. That way, a join ...
2
votes
2answers
66 views

SQL Server on Windows Server (VMware) - online storage swap

I have a VM cluster designed to store multiple SQL Server instances. We use variety of storage providers (i.e. 3PAR, XIV) which have to be changed now (not relevant to what brand). On Oracle on Linux ...
0
votes
0answers
44 views

Partition Alignment in AWS SSD EBS

I'm setting up a new SQL Server 2008 r2 in AWS with IO1 SSD EBS volumes. My smaller EBS volumes are aligned correctly when they were formatted but the larger volumes, 3TB, are not because they used ...
-1
votes
2answers
133 views

EAV in postgresql

I'm building an application that needs to be deployed several times, with a relatively well organized data model. A table needs to be configured for each deployment with a small number of additional ...
15
votes
5answers
500 views

Attempts to reclaim unused space causes the used space to increase significantly in SQL Server

I have a table in a production database that has a size of 525 GB, of which 383 GB is unused: I'd like to reclaim some of this space, but, before messing with the production DB, I'm testing some ...
0
votes
3answers
179 views

Replace column by LEFT OUTER join to save space

I have a table t1 with 100M row. For column A, 95% of the rows have value NULL0, the other records have values from 1 to 9. To shrink my table, I'm thinking about moving column A to table t2. t2 ...
0
votes
0answers
68 views

How to switch MBR to GPT without losing any existed data originally in MBR, AWS Ubuntu EC2

I'm trying to extend my diskspace for my AWS EC2 Ubuntu instance, the partition I've started with is MBR and the maximum it can go is 2TB. Currently the diskspace is full with important data, I need ...
16
votes
4answers
3k views

SQL Server has encountered occurences of I/O requests taking longer than 15 seconds

On Production SQL Server, we have following config: 3 Dell PowerEdge R630 servers, combined into Availability Group All 3 are connected to single Dell SAN storage unit which is a RAID array From ...
0
votes
1answer
53 views

Backup Compression SQL Server vs PURE

We are having a SQL 2016 Standard Edition Server holding 4TB of data. And the compressed backup using maintenance plans is taking around 1.5 hrs. Our storage team claims that as PURE FlashArray is ...
0
votes
1answer
45 views

Is it better to install a very large Postgres database (billions of rows) in a real or a virtual machine? [closed]

From my common sense, my physical machine hosting a very large Postgres database (for big data) should be real rather than virtual or container. Some people say it is better to install on a virtual ...
2
votes
1answer
94 views

Understanding the differences in the storage space used by two tables

I have two tables in which, more or less, one contains a subset of data of the other one. There is some data I delete from the first table, which is inserted in the second one as historical data. ...
2
votes
0answers
143 views

Postgres configuration for high-latency storage

I'm trying to setup a postgres server using Ceph as storage. After taking benchmarks, it was obvious that even though the storage has a really good throughput, the higher latency brought by network ...
1
vote
1answer
153 views

Which Oracle datafiles grow in size?

I have downloaded and started up Oracle's pre-built OTN Developer Day VM. The VM is running on an SSD. I want to move datafiles that can grow to a separate mount point (setup as a vmdk on a HDD. more ...
1
vote
1answer
67 views

How to point tablespace in Oracle's pre-built Developer Day VM to another mount point

I have downloaded and started up Oracle's pre-built OTN Developer Day VM. The VM is running on an SSD. I want to load some data for development purposes. I am planning to create a new user and load ...
5
votes
2answers
619 views

Slow checkpoint and 15 second I/O warnings on flash storage

Last couple of weeks we've been working on getting to the root cause of what could likely be the cause of the occurrence of these I/O issues and slowdown of the checkpoints. At first glance it looks ...
0
votes
1answer
272 views

SQL Server Logical IO Block Sizes and Physical Reads

I am trying to understand cache churn caused by SQL statements that are doing some table scans. Assuming LRU caches, if something is doing 400K logical IOs, how much memory is streamed across (IO ...
0
votes
1answer
405 views

Should TempDB SSD Drive be formatted with 64 Kb Allocation Unit Size?

We have installed dedicated SSD drives for TempDB First question - should these drives be formatted with 64 Kb allocation size ? Currently it shows 4 Kb (Bytes per Cluster = 4096) Does TempDB ...
0
votes
2answers
286 views

How does MySQL store data, can I detach a mysql Database?

I have used SQL Server in the past which each database is kept in separate files (a data file and a log file) but things are different in MySQL as it seems. The file sizes of these files translates to ...
2
votes
1answer
152 views

Calculating total “on row” bytes for each row … the easy way

We want to calculate the total "on row" storage bytes for each row in the table. As we understand it, we must add up the DATALENGTH() of each column while also accounting for NULLs and things like ...
3
votes
1answer
526 views

RDS MySQL read replica larger than master

We have a Multi AZ AWS MySQL 5.6.40 server with a matching single AZ read replica. Both have 200GB of storage available. However, the read replica is rapidly running out of free storage space, while ...
0
votes
0answers
49 views

fix oracle 11.2 asm performances (bad disks repartition)

i've a single Oracle 11.2 node with really bad performances and i figure out that there's a lun always running at 100% IO. This is the "DATA_0000" lun configured in asm in this way SQL> SELECT name, ...
0
votes
2answers
126 views

Does an OFFLINE Database use space? [closed]

I took my SQL Server Database OFFLINE. Is it still occupying the same space as when it was ONLINE? Should I keep it OFFLINE or is it better to BACKUP the database and DROP it?
0
votes
0answers
58 views

How Blockchain Databases Work

I feel like I read somewhere back about blockchain databases but I can't seem to find anything too solid on the topic. This paper called Blockchain Databases doesn't offer much in terms of description....
1
vote
0answers
122 views

“Slow Storage Writes on Drive T” warning from sp_Blitz

We migrated our platform to new SQL Server 2016 instances a couple of nights ago. Immediately following the migration, we ran sp_Blitz again, but noticed the following entry, which relates to the ...
1
vote
2answers
134 views

Is there a disk space impact when choosing NULL vs empty array {} for the default of an ARRAY[] column? [duplicate]

My intuition is NULL will take up less space than {} when used as the default value of an ARRAY[] column in PostgreSQL. Am I correct?
0
votes
3answers
58 views

Can I move / Modify the Object in Object Storage Service (OSS)

I am using Alibaba Cloud - ECS and have Storage Bucket - Object Storage Service (OSS). File Storage structure is like oss:/bucket/abc/xyz/123.jpg/ My Question is Can I move or modify the objects ...
1
vote
0answers
40 views

How should I organize my physical storage on 5 ssd single server for 2.2 TB database

I need to migrate a 2.2 TB database to a better organized single server with 12 physical cores. New server has 5 SATA SSDs 1 TB each, will upgrade to 6 SSDs 1 TB each. My current design is (this is ...
9
votes
2answers
256 views

Increased waits during checkpoint after upgrading to better storage

When we migrated from an older all flash array, to a newer all flash array (different, but well established vendor), we started seeing increased waits in SQL Sentry during checkpoints. Version: ...
-3
votes
1answer
52 views

Can we shrink a 1.6 TB SQL Server DB in Simple mode with only 12 GB Storage left?

We saw your article about this topic and wondered if you can answer this question: Can we shrink a 1.6 TB SQL Server DB in Simple mode with only 12 GB Storage left? Here is your article that we saw: ...
3
votes
0answers
330 views

How Graph Databases Store Data on Disk

I have seen these papers: TurboGraph GraphChi BiShard Parallel Processor G-Store NXgraph GridGraph ...and a few others. I am new to databases (other than having used them for web apps without ...
2
votes
1answer
56 views

How to Store Trees on Disk

I am wondering how to store trees on a physical disk, for perhaps a tree-oriented database like an XML database. Wikipedia states about XML databases: ...custom optimized data structures are used ...
1
vote
1answer
56 views

How Database Formats Files for Disk

This SO answer outlines how MySQL organizes its database into files, but doesn't describe the structure of the files themselves. I am wondering, at the physical level, how relational database ...
11
votes
1answer
6k views

What are the current best practices concerning varchar sizing in SQL Server?

I'm trying to understand the best way to decide how big varchar columns should be, both from storage and performance perspectives. Performance From my research, it seems that varchar(max) should ...
5
votes
2answers
2k views

In what cases are BLOB and TEXT stored in-line on InnoDB?

I've googled this and can't find it, you can see Rick James mention it here. ... BLOB and TEXT are not always stored separately The answer on What is the difference between MySQL VARCHAR and TEXT ...
0
votes
1answer
36 views

Shrinking the database partition if autogrow is turned off?

I want to know: Are there chances of shrinking the database partition if autogrow is turned off? Also, are there chances of data fragmentation and increase in seek times if we fully extend size ...
-3
votes
2answers
67 views

What are some real world applications that generate large numbers of records in a database every day and what are those metrics? [closed]

I'm trying to get some perspective in today's day and age what is considered a large amount of data or large number of records generated in a day and what real world applications are doing that. I ...
1
vote
2answers
53 views

How does the optimizer in Oracle Database use I/O statistics?

I would like to help Oracle's query optimizer make better-informed decisions. I have been unable to find much information on how the optimizer determines the cost of I/O operations, other than ...
16
votes
1answer
574 views

CREATE DATABASE on RAW partitions no longer works?

I'm attempting to create a database using two raw, i.e. unformatted, partitions. Microsoft Docs states you can do this, you simply need to specify only the drive letter of the raw partition, as in: ...
3
votes
1answer
179 views

Tempdb size strategy

I've recently started my role as a DBA and my initial task has been to take ownership and redeploy a database provided by a 3rd party to help us conform to GDPR legislation. As a consequence, I've ...
5
votes
4answers
2k views

Best way to store physical stock data in a SQL db

I work for a retail company and we are in the process of building a new data warehouse. One element we need to store is physical stock data as to how many units of any sku are available at a certain ...