Questions tagged [storage]

For questions about the persistent storage of database data.

Filter by
Sorted by
Tagged with
3
votes
2answers
371 views

RAID Storage Technology Outdated? [closed]

I am working on designing requirements for new SQL Server installation. I have been researching disk storage and everything seemed to point to using RAID. However, I found this article, which ...
0
votes
2answers
1k views

PostgreSQL 9.3 - standard_confirming_strings option in postgresql.conf not affecting remote machine

I am updating a program at work that communicates with a postgreSQL 9.3 database. I need to turn off an option in the postgresql.conf file called standard_conforming_strings, so that I can store ...
2
votes
1answer
82 views

Reference implementation of a scalable storage system with strong consistency?

Is there a storage system with these properties? horizontally scalable - can handle arbitrary read and write throughput if you add enough nodes to the cluster consistent, in the sense that all reads ...
0
votes
1answer
194 views

Does database require block storage always?

I was reading the difference between block, file and object storage and I read somewhere that database require the underlying storage to be block storage. Is this true? Can I not install a database on ...
6
votes
1answer
9k views

Partition Style - MBR or GPT

I am setting up a new server and I am designing the server for performance over capacity. Planning the disk partitioning style I would like to use GPT over MBR but am not sure which is best. I am ...
0
votes
5answers
1k views

Is it impossible to store 2^266 records on a database of some kind? [closed]

Each records weighs 52 bytes, is it possible in today's technology if someone had the storage needed? What kind of db would hold the data and will make it possible to retrieve it. An example record: ...
3
votes
1answer
820 views

Use of integer instead of interval (of one type)

Our DB design presently has a interval column which will only be storing days (no other interval type) so it is making sense to use INT2 (smallint) instead of interval. Reference to documentation. ...
1
vote
2answers
2k views

SQL Server storage limits on Azure

Looking at SQL Server maximum capacity limits on here: http://msdn.microsoft.com/en-us/library/ms143432(v=sql.120).aspx Database size can be as big as 524,272 terabytes. Here, you could see VM size ...
1
vote
1answer
3k views

I have delete database from mysql but storage is not freed

I have deleted multiple databases (schema) from mysql on amazon RDS but the storage is not freed, is there anything else I should do to free up the storage? I have a mysql database that the total ...
0
votes
1answer
437 views

ERP (Oracle) real time backup [closed]

I work in a small company, that runs an ERP that holds about 600MB of data. My task at hand is, to find a way to always have real time backup of the erp (Oracle 11g) that can be retrieved easily (so ...
1
vote
0answers
44 views

Data mirroring suggestions

On my test environment, I have a SQL 2012 2-node physical cluster that accesses a common iSCSI storage on a separate Windows Server 2012 box. What options are there if I want to backup this storage to ...
2
votes
0answers
757 views

How to use Blob Storage as shared storage in a Windows Azure Failover Cluster?

In the context of SQL Server 2012 Standard Edition, is it possible to make Azure Blob storage available to a SQL Failover cluster directly as a shared SCSI resource on a Windows Cluster composed on VM'...
0
votes
1answer
230 views

What are the low-level storage requirements? [closed]

Typically, DB engine fulfils some request and any modifications must stay persistent (you call it durability). How is the persistence is ensured/assumed? Which requirements are imposed on the HW/OS? ...
2
votes
1answer
251 views

SQL Server data files and RAID

I have a server with a RAID1 volume (OS + apps) and a RAID10 volume (database). The RAID10 volume has 6 physical disks. Should I split the SQL Server database into 6 datafiles (one for each physical ...
0
votes
1answer
122 views

Allocating Filegroups and Storage

I have upto 10 databases running on a single SQL Server instance on a single server. I have read about best practice for storage and concluded the following... 1) Transaction Log on own RAID array (...
0
votes
3answers
198 views

SQL Server RAID Storage [closed]

I have been reading about recommended SQL Server storage and RAID 5 or RAID 10 controllers have been recommended. On my existing Database server I can see 4 Storage controllers under Device Manager. ...
1
vote
2answers
6k views

What is the default size of text field in Postgres?

In the official documentation (http://www.postgresql.org/docs/9.1/static/datatype-character.html), it states text field is variable unlimited length. I wonder what is the default size of this field ...
44
votes
2answers
41k views

Best way to populate a new column in a large table?

We have a 2.2 GB table in Postgres with 7,801,611 rows in it. We are adding a uuid/guid column to it and I am wondering what the best way to populate that column is (as we want to add a NOT NULL ...
5
votes
4answers
2k views

Is database partitioning for performance reasons meaningful in a virtualized environment?

When running SQL server on physical hardware, placing database data and log files on separate disks or RAID arrays can benefit performance, resilience, and maintenance. Partitioning the database over ...
2
votes
4answers
2k views

What is a Scalable Storage Mechanism for large TTL data collections

We currently have a legacy webservice that stores each xml request/response in Sql Server. The data only needs to persist for 3 days before it is considered expired. Sql Server is not good at deleting ...
1
vote
2answers
225 views

Single disk for Data, System, User, Temp and Backup when installing Fail Over Cluster?

I have a Windows cluster with two nodes. I am trying to make Fail Over Cluster using SQL Server 2012. On both nodes there is 2 TB storage available which I can access as: C:\Storage_For_Cluster\...
3
votes
1answer
274 views

Help with Cybernetics SAN Configuration

There are tons of articles out there recommending RAID/ LUN/ drive configurations for SQL Servers, but most leave me still questioning as they usually state "it depends" and for this reason ...
2
votes
1answer
2k views

Need a solution to store cheaply a big MongoDB collection

We have the typical problem of Twitter's timeline tweets, or Facebook profile's news: we need to show the users only the new information (storing them in a fast db), and put all the old ones somewhere ...
0
votes
1answer
399 views

Help with Postgres 9.1 data import (is 4x expected data size, 4x slower than MySQL, and index still needed)

I have 25 billion <int, int, float> rows that I'm trying to import into Postgres, and after 77% of the data being imported, the Postgres data folder is taking up 840GB, about 4x the storage ...
2
votes
1answer
174 views

Meaning of SQLIO output “counts per second”

I realise that my question isn't strictly 'database' but I know that a lot of DBA's will use the SQLIO tool to check I/O performance on their systems so I'm hoping that somebody here will be able to ...
2
votes
0answers
366 views

always on availability group with different speed disks

I'm looking to set up SQL Server 2012 installation with an Always On Availability Group, where the 'passive' replica will be hosted at another site on the WAN and using synchronous data commit - the ...
0
votes
1answer
223 views

How would you track DB storage use and then extrapolate it?

I need to track the size of various DBs we have, then see it's growth rate so that we can guess where it will be at certain times. I'm using Oracle 11g first, but will eventually be applying this to ...
5
votes
1answer
8k views

How to determine Oracle LOB storage footprint?

With SECUREFILE storage I can specify whether I want compression (and the level of it) and deduplication, and it's all a trade-off between time and space. Timing is fairly easy to profile but what's ...
1
vote
1answer
1k views

Any way to estimate the required space for a SQL dump file?

I want to import a Wikipedia XML dump file into MySQL. The uncompressed XML dump file is 65GB. Does this mean I should free up almost 64GB in the MySQL data path? Is there any way to estimate the ...
3
votes
1answer
1k views

How un-clustered is a CLUSTER USING table in PostgreSQL

I have some tables which benefit greatly from CLUSTER ON/CLUSTER USING in Postgres SQL: # CLUSTER table USING index_name; # ANALYZE VERBOSE table; # CLUSTER VERBOSE; A maintenance task periodically ...
8
votes
2answers
475 views

Are database query optimizers aware of storage performance differences?

As I understand it, the query optimizer in SQL Server (or any other RDBMS, really) isn't aware of the performance of the storage underneath the database, and will make decisions as if all storage has ...
6
votes
2answers
9k views

do MYSQL views occupy physical space?

do MYSQL views occupy physical space? Or in other words, is a MYSQL database limited to a certain number of views?
-1
votes
1answer
96 views

best database for a real estate system [closed]

Which is the best database suits for a real estate system. Considering the storage space, security, crash recoveries, speed etc. There will be around 1000 fields and trillions of rows!!!
6
votes
2answers
4k views

Multiple SQL Server data files on same SAN disk

I'm currently in the process of creating a new database, and have previously only ever used a single data file and a single log file. I've done some research online regarding the benefits of multiple ...
8
votes
3answers
7k views

Stop SQL Server service(s) before defragmenting drive?

Our production SQL Server 2005 database's data files live on a separate physical drive, which Microsoft Windows 2003's Disk Defragmenter tool reports as 99% fragmented. We scheduled a task to ...
4
votes
2answers
4k views

How to Correctly Estimate the Average Number of I/O Operations my RAID 10 disk can offer?

The average Input/Output Operations per Second a disk can sustain is a very important factor in the tuning of MySQL / InnoDB databases, as it drives the speed with which Dirty InnoDB Buffer Pool pages ...
8
votes
4answers
11k views

SQL Server - Separating data, log, and TempDB files on a SAN

I have a SQL Server connected to a SAN. Our new storage vendor recommends that all LUNs span the entire disk array, which is RAID5. I would normally request 3 separate LUNs (data, log, and TempDB) ...
4
votes
1answer
292 views

Performance for fast filling table

I am currently creating a web application using the twitter streaming API and would need some advice concerning my database scheme. I basically have a list of hashtags that I track in real-time. All ...
8
votes
2answers
11k views

Splitting TempDB into multiples files equal to number of CPUs

The article SQL Server tempdb Best Practices Increase Performance suggests that I should split tempdb into a number of files equal to the number of cores. So for 4 cores you get 4 files. By having ...
3
votes
4answers
7k views

How to prevent SQL Server database server from running out of disk space?

What are the best preventive approaches that we can do to prevent the SQL Server database server from running out of disk space ? Is there a way to set the maximum database file size (both the ...
3
votes
1answer
7k views

How to determine the read / write ratio of your server?

When looking at the read / write ratio of your server would you look at the NUMBER of reads and writes or the number of BYTES read and written? For example, consider the following numbers from sys....
2
votes
2answers
107 views

Can I see the RAID group name for my SQL Server Database files?

Is it possible to see the RAID group name that my database (and log) files are sitting on, in one of the DMVs (or some other system table) ?
0
votes
1answer
2k views

Too many records on database and how to handle it? MySQL is it good to clone?

I am doing a social network and came up with the following concern regarding database storage. Let's put facebook as an example, imagine 2,000 photos per user, just 1,000 users, it would equal to 2,...
4
votes
1answer
830 views

Query to check where database growth was?

I have a database that grew very significantly overnight and I'd like to find out why. I've restored yesterdays backup to another location. Is there a query I can run to query the size of tables or ...
1
vote
1answer
654 views

Setting up DRBD on an active MySQL server

When it comes to setting up DRBD and MySQL, is the following possible? Set up DRBD on an active MySQL server Set up DRBD with no downtime allowed
4
votes
2answers
1k views

Enumerate drives available to SQL Server

I'm trying to work out a way of listing the drives that a particular instance of SQL Server is "aware" of, and understand the process. I can run EXEC master..xp_fixeddrives which gives me a list of ...
9
votes
1answer
4k views

Optimal placement of tempdb, mdf and ldf files in SQL Server 2012 on SSD's?

I realize this is probably a very open ended question and the answers could vary, but what is the optimal placement for the tempdb, mdf and ldf files in SQL Server 2012 when talking SSD's? Pre-new-...
2
votes
1answer
661 views

Creating the database on different file groups

What is the pros and cons of creating the database for a operational system on different file groups? I know it is useful if you want to keep the static part of a database online when the other part (...
2
votes
2answers
374 views

Removing physical fragmentation

If I have inherited db that has grown to 400GB 1 MB chunk at at time. Is an offline defrag the only way to remove all the physical fragmentation. Another issue I have is that the data and log files ...
3
votes
2answers
352 views

SQL database backups methods-tools-procedures

Currently, I am investigating some way to more efficiently backup 4 Production SQL Databases (3 different servers/instances) and would like to know if anyone else has had the problems we are having ...