Questions tagged [storage]

For questions about the persistent storage of database data.

58 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
5
votes
2answers
143 views

Different Disk Drive Same Backend Storage

I have a database running on a VM which is getting hammered during a large load, in particular I can see waits of WRITELOG happening. My initial thought is to split the files out on to their own ...
2
votes
1answer
98 views

SQLite Internals - Records

Hey I'm trying to wrap my head around SQLite data storage, specifically how it is storing Records. I've found a book The Definitive guide to SQLlite, where the author explains internal record format (...
2
votes
0answers
320 views

Postgres configuration for high-latency storage

I'm trying to setup a postgres server using Ceph as storage. After taking benchmarks, it was obvious that even though the storage has a really good throughput, the higher latency brought by network ...
2
votes
0answers
101 views

RethinkDB storage calculations

I am trying to estimate storage requirements for the data our application will store. After doing some research I can pull out data from the stats table. However, I don't understand how those numbers ...
2
votes
1answer
504 views

How to get space used by In-Memory table in SqlServer

I'm trying to understand how much storage In-Memory table consumes in SqlServer: SELECT is_memory_optimized,durability_desc FROM sys.tables WHERE name='TBL_HSD_AD_OR' select count(*) [#Rows] from ...
2
votes
0answers
448 views

What is the storage size of a BIT (8) NULL column, and is it any different than BIT (7) or BIT (8) NOT NULL?

According to this question and the docs, the storage requirements for a BIT (M) field in MySQL are "approximately (M+7)/8 bytes". This seems awfully vague, and the answers given there don't specify ...
2
votes
2answers
104 views

IBM FlashSystem V9000 storage - should the os, mdf and ldf and tempdb be separated onto different volumes?

Is there any benefit that justifies separating the os, mdf, ldf and tempdb onto separate volumes? RAID and redundancy is already included. Connection options to the host are: 16 x 16/8/4 Gb Fibre ...
2
votes
0answers
757 views

How to use Blob Storage as shared storage in a Windows Azure Failover Cluster?

In the context of SQL Server 2012 Standard Edition, is it possible to make Azure Blob storage available to a SQL Failover cluster directly as a shared SCSI resource on a Windows Cluster composed on VM'...
2
votes
0answers
366 views

always on availability group with different speed disks

I'm looking to set up SQL Server 2012 installation with an Always On Availability Group, where the 'passive' replica will be hosted at another site on the WAN and using synchronous data commit - the ...
1
vote
0answers
26 views

MySQL - storing 162 million rows in 1 table as the result of an IFNULL query

I'm working on a legacy web application which uses a MySQL (5.5.65-MariaDB) database which is hosted on a server running CentOS Linux 7.7.1908. The application is a database of chemical substances and ...
1
vote
0answers
14 views

How to calcuate current IOPS consumed in AWS

We have a SQL Server hosted on AWS using EC2 and EBS. SQL Files are hosted on EBS. EBS vol type is GP2 and drive IOPS is 480. At an instance of time Write Througput in AWS is showing is 725 and Read ...
1
vote
0answers
153 views

MySQL Large History list length & Storage Space

Currently, my MariaDB database server is running out of space, hence I am trying to delete old records (using multiple threads with DELETE FROM tbl WHERE index > ? and index < ?). My ...
1
vote
1answer
291 views

Which Oracle datafiles grow in size?

I have downloaded and started up Oracle's pre-built OTN Developer Day VM. The VM is running on an SSD. I want to move datafiles that can grow to a separate mount point (setup as a vmdk on a HDD. more ...
1
vote
0answers
160 views

“Slow Storage Writes on Drive T” warning from sp_Blitz

We migrated our platform to new SQL Server 2016 instances a couple of nights ago. Immediately following the migration, we ran sp_Blitz again, but noticed the following entry, which relates to the ...
1
vote
0answers
58 views

How should I organize my physical storage on 5 ssd single server for 2.2 TB database

I need to migrate a 2.2 TB database to a better organized single server with 12 physical cores. New server has 5 SATA SSDs 1 TB each, will upgrade to 6 SSDs 1 TB each. My current design is (this is ...
1
vote
0answers
57 views

EMC Recoverpoint works for database?

As a solution for replication, to protect VM, LUNs and recovery including database, EMC Recoverpoint was presented by our vendor. But in EMC paper's, the only one database related example ilustrates ...
1
vote
1answer
73 views

What does column family-oriented datastore mean in practice

I was reading this article about HBase. Within it, the storage format of HBase is described: HBase is referred to as a column family-oriented data store. It’s also row-oriented: each row is indexed ...
1
vote
0answers
644 views

SQL TempDB PCI-E NVMe card - 4K or 64K

Our primary OLTP workload is tempdb heavy (both reads & writes) based on virtual_file_stats DMV, and based on SPs all of which heavily use #tmp tables. The server has 400GB of memory, more than ...
1
vote
0answers
551 views

Why is SQL Server unable to access partitions stored on UNC paths?

I have a database with its primary file and log file stored locally. One table is split into 101 partitions which are stored on a Windows share on another server accessed by a UNC path. Each partition ...
1
vote
0answers
59 views

What parameters should I use to measure storage I/O capabilities

I want to measure the throughput of my disk subsystem using: https://gallery.technet.microsoft.com/DiskSpd-a-robust-storage-6cd2f223 what parameters should I use to closely emulate SQL I/O? Is there ...
1
vote
0answers
238 views

Why ndb data memory is 94% if i m using disk storage cluster

I have following structure 2 data node 1 management node 2 sql node i have create one log file of initial size 200M then created table space and added 3 data file data1.dat (initial size: 10GB) ...
1
vote
1answer
92 views

Shared logarch across multipe db2 HADR instances

Background We are looking into building a multiple standby hadr cluster. The Auxiliary standby is in a geographically separate location. from Developer works In a multiple standby system, the ...
1
vote
1answer
64 views

Windows Clustering and SQL Availability Groups

I am new to Clustering and Availability groups. I am creating a 4 node Windows 2012 Cluster with SQL 2016 enterprise. SQL will not be clustered we are just using the availability group option. The ...
1
vote
0answers
616 views

What to choose for SQL Server storage - RAID 5 with 15K drives or RAID 10 with 10K drives

Im looking to configure a new sql server with a dell r730xd 24 bay chassis and need some help with choosing the drive configuration for sql server. Need help on what to choose for our RAID ...
1
vote
0answers
577 views

Storing and searching user location using latest MySQL 5.7 spatial features

I want to use MySQL spatial features to store user location. I have read about MySQL spatial geometry data type. According to this article this works very well in MySQL 5.7 http://mysqlserverteam.com/...
1
vote
0answers
595 views

SQL Server index rebuild cause database growth

I have a 80GB database with about 20GB of indices size. Whenever I build the indices online the database file will grow to gain 20GB of unallocated space, and if the unallocated space is less than ...
1
vote
0answers
84 views

Split Mirror Backup in db2

In my database apart from storing the daily backup, the disks are getting used for other purposes also. So how can I do the disk mirroring for Split Mirror Backup if I don't use external storage?
1
vote
1answer
49 views

ASM and IPv6 Compatibility

In the whitepaper mentioned below, Under 'Limitations' it says ASM and fan based notifications are not supported by IPv6 in Oracle. I'm just curious what ASM has to do with ipv4 or ipv6 or ipv4? ASM ...
1
vote
0answers
328 views

How calculate per tenant disk usage in a multitenant database with tenant_id columns?

I would like to provide forum hosting as a service, for forum software I'm developing. The data is stored in a PostgreSQL database, in tables with a forum_id column. That is, all forums share the same ...
1
vote
0answers
44 views

Data mirroring suggestions

On my test environment, I have a SQL 2012 2-node physical cluster that accesses a common iSCSI storage on a separate Windows Server 2012 box. What options are there if I want to backup this storage to ...
1
vote
1answer
333 views

NVMe+bcache as huge storage cache for vertica database

We are in process of selecting hardware for 3 machines vertica cluster capable to serve 20-30TB of data (15TB compressed). This translates to 8TB of post-RAID storage. With 16 CPU cores, the storage ...
1
vote
1answer
98 views

Remove Local RAID Drive from MS SQL Windows Cluster

We recently stood up a production SQL Server 2014 Enterprise on a two-node Windows Failover cluster (Active/Passive). We had some SSD's laying around and decided to use them for the tempdb for one of ...
0
votes
1answer
61 views

ORACLE ASM present one or more LUNs?

I have the following question regarding the allocation of disks or LUNs to ASM in Oracle, specifically, I have an Oracle 18c DB in Cluster and I have created several diskgroups, now, I need to ...
0
votes
0answers
245 views

SQL Server placement of Files SAS SSD vs SAS HDD

I've got a new server which will host MS SQL Server Virtual Machine along with Other VMs on HyperV. SQL Server will account for most(70%) of the Load. The server has below Storage: a. 2 x 240GB Read ...
0
votes
1answer
48 views

What is the point of encryption at rest?

I am wondering what is the point of encryption at rest? It is said that a hacker cannot steal the database and look through it. I'm afraid that it does not protect the database while the key is stored ...
0
votes
0answers
26 views

db choice for activity log

I'm working on a geo-replicated web platform, composed of an ecosystem of microservices. We need to improve and rework the user activity tracing pipeline and I'm looking for "the best" ...
0
votes
0answers
54 views

Storing data for machine learning in MySQL

I am currently in the process of developing a machine learning application, where my users can upload their own data to train models. Furthermore, the users must be able to extend their uploaded data ...
0
votes
0answers
34 views

MYSQL storage increasing unexpectedly (RDS)

I am total newbie to database game. & I am using mysql 8.0 RDS 20GB free tier. I don't have much data on it.(just 300 Mb) But I always get a mail that you have exceeded 85% of storage limit.(...
0
votes
0answers
223 views

Which MySQL settings are the closest equivalent to RDS' “Queue depth”?

I'm trying to find out which MySQL status variables can be used to get as close as possible to the RDS value of "Queue depth". On a test system, I reckon that %pending% variables may be at least a ...
0
votes
1answer
35 views

MySQL datafiles on SMB3 network storage

We have MySQL-server on Ubuntu with InnoDB-datafiles on a local disk. As part of an upgrade program, the company is planning to put the datafiles on a Windows fileserver where they can be mounted with ...
0
votes
0answers
76 views

Partition Alignment in AWS SSD EBS

I'm setting up a new SQL Server 2008 r2 in AWS with IO1 SSD EBS volumes. My smaller EBS volumes are aligned correctly when they were formatted but the larger volumes, 3TB, are not because they used ...
0
votes
1answer
172 views

Backup Compression SQL Server vs PURE

We are having a SQL 2016 Standard Edition Server holding 4TB of data. And the compressed backup using maintenance plans is taking around 1.5 hrs. Our storage team claims that as PURE FlashArray is ...
0
votes
2answers
885 views

How does MySQL store data, can I detach a mysql Database?

I have used SQL Server in the past which each database is kept in separate files (a data file and a log file) but things are different in MySQL as it seems. The file sizes of these files translates to ...
0
votes
0answers
58 views

fix oracle 11.2 asm performances (bad disks repartition)

i've a single Oracle 11.2 node with really bad performances and i figure out that there's a lun always running at 100% IO. This is the "DATA_0000" lun configured in asm in this way SQL> SELECT name, ...
0
votes
0answers
65 views

How Blockchain Databases Work

I feel like I read somewhere back about blockchain databases but I can't seem to find anything too solid on the topic. This paper called Blockchain Databases doesn't offer much in terms of description....
0
votes
1answer
55 views

Is it possible to allocate data free for certain table?

After deleted a large dataset (~50GB) and optimized tables, some tables have data free (~50GB) and parts of tables have only data free (~KB). As my understanding, the data free are reused and not ...
0
votes
0answers
34 views

Storing a lot of text / string data strategies - analysis and solution

I have a LOB application backed by SQL Server 2016. Over the past few weeks, theres been issues whereby the SQL Server start throwing timeout errors - which has led to a bit more digging into the ...
0
votes
0answers
37 views

How to use container to do database high availability?

About traditional database high availability, the method is like: master-master replication master-slave replication automatic failover If use container to do that, we can use these ways: Use ...
0
votes
2answers
94 views

How to install MongoDB database as a service in ESxi?

I want to know is it possible to install mongodb directly to the ESXi without guest OS? Please tell me how to setup Data storage as a service environment inside ESXi.
0
votes
1answer
80 views

Storage does not failover in Windows cluster

I created a lab setup for a 2 node cluster using Windows 2012 R2. I first configured the quorum and performed a failover between both the nodes, the quorum would also map to the respective node. But ...