Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [hardware]

The tag has no usage guidance.

1
vote
1answer
68 views

32GB RAM needed to work with 200.000.000 rows in MongoDB?

I've been playing with a large dataset, consisting of a few tens of billions of rows of small ascii strings. I want to count the number of occurrences of each string in the dataset, and i suspect the ...
13
votes
1answer
450 views

Does SQL Server 2017, including older versions, support 8k disk sector sizes?

Disk (loosely worded to include not only rotational media but non-rotational media [SSD, NVMe, etc.]) drives are continuing to evolve in their underlying formats and hardware. Part of this was an "...
1
vote
1answer
64 views

Performance of mysql equi-join observed in HDD and SSD

I experimented performance of queries having equi-joins. I have simplified version of EXPLAINs of the queries. Mysql version : 5.7.18 Engine : Innodb Cache state : Mysql restarted before experiment ...
0
votes
1answer
104 views

DB server VM's CPU configuration - 1x2Ghz or 2x1Ghz - which is better

We want to set up DB server in cloud hosting for MS SQL Server Express edition - OLTP workload for "just" 6 concurent users - mostly short and small transactions. Hosting company is charging each ...
2
votes
2answers
82 views

How to spec a machine for a particular database load?

Our primary authentication database that is used for 100k+ users, and growing is a VM on a shared machine that we want to extract into its own isolated hardware. This will let us isolate resources, ...
0
votes
1answer
117 views

Handling Bus Error in Mongo Service

I have a Mongo service with which multiple hosts are interacting. The host on which the Mongo service is running is quite special -- it has 3TB of RAM. However, that host also throws intermittent Bus ...
0
votes
0answers
49 views

Very slow disk readind on postgres server

I hava a server for postgres only, its very slow reading on hd, something about 16mb/s or less, checked in iotop while a server overload. Two scsi disks, i have to check every information by ssh, my ...
2
votes
1answer
80 views

Disk Architecture on SQL Server [closed]

I am building a new environment using the SQL Server 2017 Always-On system. This will be active 24/7 and there will be lots of DML processes. I have a 100GB SAS for the OS, a 1TB SAS for Data and a ...
0
votes
0answers
117 views

fsync() calls significantly higher on MySQL 5.7 as compared to MySQL 5.6

We have 3 database servers currently in production running MySQL 5.6. One of these is a master and two are slaves. SHOW ENGINE INNODB STATUS shows the following, with regard to disk IO: Master (5.6) ...
0
votes
2answers
67 views

Application on Different SQL Servers

In a Sql note "you should never put applications in each other's way if you do not have to.. Applications sharing memory, CPUs, internal tempdb can cause an issue. One application submitting a ...
-1
votes
2answers
1k views

Mariadb minimum CPU requirements (Edit: Still crashing, new question with log linked)

EDIT3: Read-write splitting seems the answer as pointed by out the user dbdemon in the linked question. Internal MariaDB error code: 1927 ('Connection was killed') EDIT2: https://drupal....
0
votes
1answer
132 views

Which hard disks for PostgreSQL? [closed]

The size of the our PostgreSQL data directory is 100 GByte. Up to now we use traditional hard disk drives and hardware RAID 10. Which hard disk drives and RAID setup would give us maximum ...
0
votes
2answers
1k views

SQL SSIS Closing Files already in use

Sometimes when running SSIS packages on flat files, I receive error: "The process cannot access the file because it is being used by another process". Another person already has file opened. Is ...
1
vote
3answers
115 views

SQL SSIS Internal ETL at Company

Business Departments at our Finance company want IT to import various spreadsheets (companyid, productid, balance, transactions) into the databases. Lets say, the SQL physical server harddrive ...
16
votes
1answer
1k views

How to go about extending volumes on SQL Server boxes?

Here is a question for the sys ops out there (or those who have gone through this experience before). My company wants to allocate additional disk space on existing SQL Server boxes in production. ...
2
votes
1answer
164 views

SQL Server Hardware Specs for Analyzing TBs of Data

I am building a workstation with the purpose of analyzing multiple terabytes of data. Hundreds of tables, hundreds of columns, various data types throughout. This will include slicing-and-dicing the ...
30
votes
4answers
13k views

CPU clock speed versus CPU core count - higher GHz, or more cores for SQL Server?

We are beginning to provision a set of physical servers for a virtual cluster of SQL Server 2016 nodes within VMware. We will be utilizing Enterprise Edition licenses. We plan on setting up 6 nodes, ...
0
votes
1answer
288 views

Memory speed vs. amount [closed]

I just got talking to DBA as he asked me: What's best, memory speed or memory amount, e.g. 512GB @ 1866MHz or 768GB @ 1333MHz, when running the database in-memory? We've both been looking for stats, ...
28
votes
4answers
6k views

Do SSDs reduce the usefulness of Databases

I only heard about Robert Martin today, and it seems like he's a notable figure in the software world, so I don't mean for my title to appear as if it's a click bait or me putting words in his mouth, ...
4
votes
2answers
2k views

SSDs and 64K sectors

SSDs tend to have a natural 4K sector size as far as I know, but would it be beneficial to format Windows cluster size at 64K? This is good practice for spinning rust, but is it relevant on SSDs?
0
votes
1answer
670 views

SQL Server Virtualization best practices - NUMA, HT, Cores vs Speed

We run on Cisco UCS + VMware ESX + HP 3PAR. Host blade config : UCSB-B200-M4 , Xeon E5-2667 v3 3.1GHz , 2 sockets , 8 cores each, Hyper-Threading Active So total 16 physical cores, or 32 logical ...
2
votes
2answers
325 views

PostgreSQL on Desktop vs. Server

How does running PostgreSQL on a Windows desktop with pgAdmin III compare to running it on a dedicated server? I am trying to develop a database with very large tables (~60 million rows) with the ...
0
votes
1answer
181 views

intel p3600 SSD no increase in read speed - postgres rdbms vs hdd

We run a custom application that produces analyzable data-sets for medical research. the amount of data we have is about 600GB in form 3Billion rows distributed in 600+ tables it is hosted in ...
1
vote
2answers
307 views

Why could query performance improve enormous after db restore on new server with worse hardware?

A asp.net page doing very slow to load a list from SQL Server has increased it's performance very much after the whole database has been restored on a new SQL Server. The asp.net app has moved from ...
1
vote
1answer
181 views

MySQL Hardware Bottleneck

I have a web application that makes simple queries to a MySQL database. The database is quite large (8.4GB) and the time to lookup an entry needs to be as fast as possible. The database represents a ...
6
votes
1answer
7k views

How do you calculate how much hardware resources you need for a database?

We are in the process of scaling our database servers. I was wondering how should we calculate how much hardware resources we need for our databases? Here is a little bit information about our ...
1
vote
1answer
721 views

Hardware specs for MySQL database with millions of records

For 35 million records I have this table CREATE TABLE IF NOT EXISTS `records` ( `code` varchar(12) NOT NULL, `type` varchar(255) NOT NULL, `used` set('y','n') NOT NULL default 'n', PRIMARY ...
1
vote
1answer
143 views

MongoLab: Does hardware effect performance of a find() query [closed]

I asked a pervious question on StackOverflow about if document size affected the performance of fetching that document (the document is 3MB in size) https://stackoverflow.com/questions/30226219/does-...
1
vote
1answer
381 views

Processors: E5-4620 v2 vs E5-2620 v3 [closed]

We're debating between: R820 - E5-4620 v2 - 2.6GHz - 8 cores, 20MB Cache, 1333MHz max memory speed - max of 768GB ram - 8 core R730 - E5-2620 v3 - 2.4GHz - 6 cores, 15MB Cache, 1866MHz max memory ...
0
votes
1answer
1k views

Database storage limit for open source PostgresSQL

I just started using PostgresSQL. When I installed SQL Server Express years back, you typically had a database storage limit if you didn't install the full version. I think I remember it being 4GB, ...
2
votes
1answer
656 views

SQL Hard Drive Config?

I am setting up new server and am a little confused in my research of HD configuration. My main question is : Is it recommended to have the Trans Logs and DB logs (ldf) on separate spindles or can ...
2
votes
1answer
959 views

Using Aerospike without SSD [closed]

Is there a drawback for using Aerospike when used in non-SSD server?
4
votes
3answers
1k views

Single Virtual Drive Vs Multiple Virtual Drives for SQL Server files

Hi guys I have question about how two different Hard disk setups can possibly affect performance of my database. I have two Options. Option 1: One Physical Harddisk and then Multiple Virtual hard ...
0
votes
1answer
53 views

Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc…)? [closed]

Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? I am researching SQLOS and how threads and scheduling are handled, but I would ...
0
votes
1answer
207 views

sql server disk I/o question [closed]

I have a question on disks. How much I/O can a normal disk and a SAN disk can handle? I have heard about SAN disks should be able to handle upto 200-300 mb/sec, how much does a normal disk can handle ...
0
votes
0answers
271 views

Overcoming the HDD IOPS limits on a billion row table? Is getting SSD the only solution?

I have a table with this structure: CREATE TABLE `requests` ( `userid` int(11) NOT NULL, `messageid` int(11) NOT NULL, `queueid` int(11) NOT NULL AUTO_INCREMENT, `problem_id` int(3) NOT NULL, `...
6
votes
1answer
414 views

SQL Server 2008R2 minimum RAID/Disk config

I want to take advantage of the great price/performance offered by the new Intel E5-2620 (v2) machines being offered by some dedicated server webhosts. Unfortunately most of these E5-2620v2 dedicated ...
2
votes
1answer
225 views

SQL Server data files and RAID

I have a server with a RAID1 volume (OS + apps) and a RAID10 volume (database). The RAID10 volume has 6 physical disks. Should I split the SQL Server database into 6 datafiles (one for each physical ...
2
votes
1answer
2k views

TempDB on Solid State Drives on SQL Server Cluster

Can solid state drives be used for the TempDB on a SQL Server failover cluster if they are local drive on both machines? It is supported in 2012 but our cluster is a SQL 2005. The application that it ...
3
votes
1answer
269 views

Help with Cybernetics SAN Configuration

There are tons of articles out there recommending RAID/ LUN/ drive configurations for SQL Servers, but most leave me still questioning as they usually state "it depends" and for this reason I'd like ...
20
votes
3answers
27k views

How to optimization database for heavy I/O from updates (software and hardware)

The situation I have a postgresql 9.2 database which is quite heavily updated all the time. The system is hence I/O bound, and I'm currently considering making another upgrade, I just need some ...
15
votes
3answers
48k views

SQL Server not using all CPU cores/threads

After upgrading our SQL Server's hardware, we noticed in the Windows Task Manager that the SQL instance is only using half of the threads available to it: . The server has the following hardware ...
0
votes
0answers
81 views

Creating a dedicated HD parition at beginning of disk for data files, benefits and draw backs?

I am thinking of creating a dedicated partition on the harddisk for the mysql database data files in /var/lib/mysql , while considering those 2 points: a dedicated partition will avoid any file ...
4
votes
1answer
8k views

Large table and poor performance - what to do next?

We have a Windows 2008 R2 / SQL Server 2008 R2 (Standard) server that is used to host a single database. The database itself mainly consists of a single large table containing both live and historical ...
2
votes
1answer
166 views

Meaning of SQLIO output “counts per second”

I realise that my question isn't strictly 'database' but I know that a lot of DBA's will use the SQLIO tool to check I/O performance on their systems so I'm hoping that somebody here will be able to ...
11
votes
3answers
14k views

general memory requirements for sql server 2008 r2

I'm not experienced with DBA work, but I'm trying to make a case for requesting additional resources for our sql server and was hoping I could get some smart folks to provide a rough rough estimate of ...
8
votes
1answer
965 views

SQL Server not using available memory

SQL Server 2008 R2 Standard Edition (64-bit) on Windows 2008R2 Enterprise Server has over 300 GB of memory but total memory use in control panel never goes over 86 GB Have SQL configured to use ...
9
votes
1answer
645 views

Strange behaviour DBCC Shrinkfile

I am attempting to run a dbcc shrinkfile in chunks of 1GB against a database where 95% of the data has been archived and deleted. I'm leaft with a 235GB file where 9GB is data/indexes. I want to ...
6
votes
1answer
1k views

Optimum configuration for 4 SSD drives

I would like to move a SQL Server database from a shared configuration with the web-server to it's own dedicated box. My current budget will allow me to put 4 disks together in an array with a single ...
12
votes
2answers
7k views

More CPU cores vs faster disks

I'm part of a small company so as usual covering a number of different roles. The latest of which is procuring a dedicated SQL Server box for our .NET web app. We've been quoted on a dual Xeon E5-2620 ...