For questions about the persistent storage of database data.

learn more… | top users | synonyms

11
votes
1answer
276 views

Highly Concurrent Storage System

Imagine your requirement is that you have 3 huge tables (structured data) with say 30 billion rows in each (total size of 4TB) and your many concurrent users (which are parallel os threads on remote ...
9
votes
1answer
367 views

Disk file effects of delete and vacuum

I have a very frequently updated table with 240 million rows (and growing). Every three hours 1.5 million rows are inserted and 1.5 million are deleted. When I moved the cluster to a SSD this bulk ...
7
votes
1answer
392 views

Adding SPARSE made table much bigger

I have a generic log table, about 5m rows. There's a "strongly typed" field that stores event type, and a bunch of "losely typed" columns that contain data relevant to the event. That is, meaning of ...
7
votes
1answer
2k views

Optimal placement of tempdb, mdf and ldf files in SQL Server 2012 on SSD's?

I realize this is probably a very open ended question and the answers could vary, but what is the optimal placement for the tempdb, mdf and ldf files in SQL Server 2012 when talking SSD's? ...
6
votes
3answers
4k views

Stop SQL Server service(s) before defragmenting drive?

Our production SQL Server 2005 database's data files live on a separate physical drive, which Microsoft Windows 2003's Disk Defragmenter tool reports as 99% fragmented. We scheduled a task to ...
5
votes
4answers
5k views

SQL Server - Separating data, log, and TempDB files on a SAN

I have a SQL Server connected to a SAN. Our new storage vendor recommends that all LUNs span the entire disk array, which is RAID5. I would normally request 3 separate LUNs (data, log, and TempDB) ...
5
votes
2answers
164 views

Database placement on abstract storage structure

Often times we all hear the same thing. The recommendations on where to put OLAP/OLTP databases, where to put the tempdb, where to put transaction logs...etc. But say you are in an environment where ...
5
votes
1answer
324 views

MySQL and Solid State Disks on EMC

Since all writes and sequential reads are cached by the EMC storage system, the best use for solid state disk is to store data that has a random READ pattern. On Oracle, that is the temp tablespace ...
4
votes
2answers
3k views

Splitting TempDB into multiples files equal to number of CPUs

The article SQL Server tempdb Best Practices Increase Performance suggests that I should split tempdb into a number of files equal to the number of cores. So for 4 cores you get 4 files. By ...
4
votes
2answers
560 views

Enumerate drives available to SQL Server

I'm trying to work out a way of listing the drives that a particular instance of SQL Server is "aware" of, and understand the process. I can run EXEC master..xp_fixeddrives which gives me a list of ...
4
votes
2answers
1k views

How to Correctly Estimate the Average Number of I/O Operations my RAID 10 disk can offer?

The average Input/Output Operations per Second a disk can sustain is a very important factor in the tuning of MySQL / InnoDB databases, as it drives the speed with which Dirty InnoDB Buffer Pool pages ...
4
votes
1answer
526 views

Query to check where database growth was?

I have a database that grew very significantly overnight and I'd like to find out why. I've restored yesterdays backup to another location. Is there a query I can run to query the size of tables or ...
4
votes
2answers
1k views

Oracle extents - How can I have so many with this small size?

This is a different question than the one with the almost-identical title. Again, this is more curiosity about how Oracle Database works than anything I need to change (yes I know multiple extents ...
4
votes
2answers
212 views

SQL Filegroup degrading performance

On our dev boxes, our database resides entirely in the PRIMARY filegroup, and everything works fine. On one of our production servers, recently upgraded from 2005 to 2008, we noticed it was ...
4
votes
1answer
134 views

Are database query optimizers aware of storage performance differences?

As I understand it, the query optimizer in SQL Server (or any other RDBMS, really) isn't aware of the performance of the storage underneath the database, and will make decisions as if all storage has ...
4
votes
1answer
157 views

Performance for fast filling table

I am currently creating a web application using the twitter streaming API and would need some advice concerning my database scheme. I basically have a list of hashtags that I track in real-time. All ...
4
votes
1answer
855 views

How to best store the Google Web Ngram data?

This is a continuation of How to best store Google ngrams in a database?, which covers how to store the Google Ngram Book data. I'm looking to store the Google NGram Web data, which is slightly ...
3
votes
2answers
280 views

RAID Storage Technology Outdated? [closed]

I am working on designing requirements for new SQL Server installation. I have been researching disk storage and everything seemed to point to using RAID. However, I found this article, which ...
3
votes
1answer
134 views

Help with Cybernetics SAN Configuration

There are tons of articles out there recommending RAID/ LUN/ drive configurations for SQL Servers, but most leave me still questioning as they usually state "it depends" and for this reason I'd like ...
3
votes
1answer
188 views

How un-clustered is a CLUSTER USING table in PostgreSQL

I have some tables which benefit greatly from CLUSTER ON/CLUSTER USING in Postgres SQL: # CLUSTER table USING index_name; # ANALYZE VERBOSE table; # CLUSTER VERBOSE; A maintenance task periodically ...
3
votes
1answer
158 views

Extreme storage beasts

Intro I have derived this question from my previous question Single Drive vs Multiple Drives After getting a very detailed answer from a very helpful member RolandoMySQLDBA and learning the fact that ...
3
votes
2answers
1k views

Multiple SQL Server data files on same SAN disk

I'm currently in the process of creating a new database, and have previously only ever used a single data file and a single log file. I've done some research online regarding the benefits of multiple ...
3
votes
2answers
370 views

Windows Storage Server, SQL Server, regular files — means to protect from insider threats?

This is my first post here, and I am by no means qualified as a Windows Server or Storage Server 2008 or SQL Server 2008 administrator. I am mostly a Unix guy, however tasked with a job to investigate ...
3
votes
1answer
100 views

Use of integer instead of interval (of one type)

Our DB design presently has a interval column which will only be storing days (no other interval type) so it is making sense to use INT2 (smallint) instead of interval. Reference to documentation. ...
3
votes
2answers
550 views

Oracle extents - How can I have so few with this large size?

Note on duplication: This is not a duplicate of "Oracle extents - How can I have so many with this small size?" This is a separate question I entered which happens to be in the same domain. This is ...
3
votes
2answers
263 views

SQL database backups methods-tools-procedures

Currently, I am investigating some way to more efficiently backup 4 Production SQL Databases (3 different servers/instances) and would like to know if anyone else has had the problems we are having ...
3
votes
1answer
668 views

How to determine Oracle LOB storage footprint?

With SECUREFILE storage I can specify whether I want compression (and the level of it) and deduplication, and it's all a trade-off between time and space. Timing is fairly easy to profile but what's ...
3
votes
1answer
130 views

What are some key configuration settings for using an InnoDb table for session storage?

I want to start clustering my PHP app servers but don't want to go for a sticky-sessions load balancing setup at this point. However, I want sessions that are persisted to disk and implement proper ...
3
votes
0answers
186 views

How does Postgres Plus Cloud Database on AWS compare with the alternatives [closed]

I'm familiar with the difficulties of scaling regular postgres on AWS and the limitation of services like RDS. Postgres plus cloud database (bit of a mouthful) seems to run out of the box on AWS, ...
2
votes
2answers
231 views

Removing physical fragmentation

If I have inherited db that has grown to 400GB 1 MB chunk at at time. Is an offline defrag the only way to remove all the physical fragmentation. Another issue I have is that the data and log files ...
2
votes
1answer
368 views

Creating the database on different file groups

What is the pros and cons of creating the database for a operational system on different file groups? I know it is useful if you want to keep the static part of a database online when the other part ...
2
votes
1answer
133 views

SQL Server data files and RAID

I have a server with a RAID1 volume (OS + apps) and a RAID10 volume (database). The RAID10 volume has 6 physical disks. Should I split the SQL Server database into 6 datafiles (one for each physical ...
2
votes
2answers
98 views

Can I see the RAID group name for my SQL Server Database files?

Is it possible to see the RAID group name that my database (and log) files are sitting on, in one of the DMVs (or some other system table) ?
2
votes
1answer
100 views

Meaning of SQLIO output “counts per second”

I realise that my question isn't strictly 'database' but I know that a lot of DBA's will use the SQLIO tool to check I/O performance on their systems so I'm hoping that somebody here will be able to ...
2
votes
1answer
46 views

What will happen when a forum uses 24 char length as an URL ID?

I found a forum using self made/custom engine still in beta version, previously using vBulletin. Now, their new engine uses very long URL id, 24 char length. ...
2
votes
2answers
845 views

Effective backup and archive strategy for database and linked files

I am using Postgres to store a variety of application data for a webapp. Part of the application involves storing and retrieving user uploaded files. I am storing the files in the filesystem with ...
2
votes
1answer
415 views

Partition Style - MBR or GPT

I am setting up a new server and I am designing the server for performance over capacity. Planning the disk partitioning style I would like to use GPT over MBR but am not sure which is best. I am ...
2
votes
1answer
1k views

How to determine the read / write ratio of your server?

When looking at the read / write ratio of your server would you look at the NUMBER of reads and writes or the number of BYTES read and written? For example, consider the following numbers from ...
2
votes
0answers
142 views

SQL Server 2012 Database Engine Configuration Storage type Raid [closed]

I just inherited a Server that I have to rebuild for SQL Server 2012, I was wondering what would be the best disk configuration for the database engine. This is what I have: 6 x 300GB 10k: 2 x 1TB ...
2
votes
0answers
131 views

How to use Blob Storage as shared storage in a Windows Azure Failover Cluster?

In the context of SQL Server 2012 Standard Edition, is it possible to make Azure Blob storage available to a SQL Failover cluster directly as a shared SCSI resource on a Windows Cluster composed on ...
2
votes
0answers
171 views

always on availability group with different speed disks

I'm looking to set up SQL Server 2012 installation with an Always On Availability Group, where the 'passive' replica will be hosted at another site on the WAN and using synchronous data commit - the ...
1
vote
3answers
697 views

do MYSQL views occupy physical space?

do MYSQL views occupy physical space? Or in other words, is a MYSQL database limited to a certain number of views?
1
vote
4answers
367 views

What is a Scalable Storage Mechanism for large TTL data collections

We currently have a legacy webservice that stores each xml request/response in Sql Server. The data only needs to persist for 3 days before it is considered expired. Sql Server is not good at deleting ...
1
vote
1answer
29 views

Copying database to different hard disk

Total noob at database administration here, excuse my ignorance. I have a server running a Rails application that's using PostgreSQL. The database is saved on drive /z/, which seems to have filled ...
1
vote
1answer
404 views

Storing Passport Numbers in a database

We're developing a travel/tourist application for a tours company who want to be able to input traveler information into an online database. Is there any security best practice for storing passport ...
1
vote
2answers
138 views

Independent pairs of RAID 1 is superior to RAID 10 [closed]

I am rather new to databases. I was reading up on RAID Storage and it seems that the consensus is that RAID 10 is RAID 10 is best is terms of performance and redundancy However at the end ...
1
vote
2answers
134 views

Single disk for Data, System, User, Temp and Backup when installing Fail Over Cluster?

I have a Windows cluster with two nodes. I am trying to make Fail Over Cluster using SQL Server 2012. On both nodes there is 2 TB storage available which I can access as: ...
1
vote
1answer
36 views

Dividing data from one table to multiple storage

I have the following tables: [Table_A] [Table_A_Changes] The two tables are pretty large (more then 50GBs). The first one contains some data, and the second one records' changes.The database is in ...
1
vote
1answer
48 views

Reference implementation of a scalable storage system with strong consistency?

Is there a storage system with these properties? horizontally scalable - can handle arbitrary read and write throughput if you add enough nodes to the cluster consistent, in the sense that all reads ...
1
vote
1answer
302 views

Need a solution to store cheaply a big MongoDB collection

We have the typical problem of Twitter's timeline tweets, or Facebook profile's news: we need to show the users only the new information (storing them in a fast db), and put all the old ones somewhere ...