Questions tagged [hardware]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
2 answers
406 views

High Load MariaDB Cluster (Galera Multi Master Replication) - Same hardware needed for Slaves?

My Galera Cluster is on very high load. To run it fine, I´m using strong hardware and for sure a lot of custom MariaDB settings and custom OS tweaks. Now, I want to add Slaves to get "realtime&...
0 votes
0 answers
24 views

Postgres DISK IO very high

I have very little experience in database administration, so I would like to ask you for help. I'm working on a home project that collects product information from one of the marketplaces. I'm ...
0 votes
2 answers
869 views

Handling Bus Error in Mongo Service

I have a Mongo service with which multiple hosts are interacting. The host on which the Mongo service is running is quite special -- it has 3TB of RAM. However, that host also throws intermittent Bus ...
0 votes
2 answers
36 views

Understanding Secondary Log Hard Disk Impact on Write Speed and Data Integrity After Power Outage

I've recently come across the notion that a secondary log hard disk can be employed to enhance write operation speed in a database system. I find this concept intriguing but am struggling to grasp the ...
0 votes
1 answer
43 views

What is a common type of storage hardware for dedicated MySQL servers? [closed]

I am curious what kind of storage hardware is common to see in servers that are dedicated for MySQL ? For example online services like Amazon AWS, Azure, Google, etc that offer(ed) dedicated mysql ...
2 votes
1 answer
686 views

SQL Hard Drive Config?

I am setting up new server and am a little confused in my research of HD configuration. My main question is : Is it recommended to have the Trans Logs and DB logs (ldf) on separate spindles or can ...
0 votes
1 answer
71 views

How to tell if a MySQL query speed is bottlenecked by storage or CPU speed?

Using MySQL 8.0.30 on Rocky Linux 9 For slow MySQL queries in general, not for a speciffic one, is there a way to tell if query speed was bottlenecked by storage speed, cpu speed, or maybe even ram ...
0 votes
1 answer
35 views

Minimizing MySQL full text query times on news database

I have a MySQL Database of 250,000 news articles. With time, it's size will continue to increase by at least 250,000 articles per year. I'm doing full text searches on this database to find articles ...
0 votes
1 answer
83 views

Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? [closed]

Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? I am researching SQLOS and how threads and scheduling are handled, but I would ...
8 votes
1 answer
476 views

Strategies for organising SQL Server with large amount of RAM

We now have a new server for our DB and amongst other things we have 128GB of RAM available (previously I had 16GB) . I know SQL Server is very good at managing it's resources, but I was wondering if ...
16 votes
3 answers
58k views

SQL Server not using all CPU cores/threads

After upgrading our SQL Server's hardware, we noticed in the Windows Task Manager that the SQL instance is only using half of the threads available to it: . The server has the following hardware ...
0 votes
1 answer
66 views

Dell Server Raid 1 drive quick replacement with 2 exact copies

Apologies if I am posting this to the wrong place. We are unfortunately having to handle our own server administration in-house and no one here is an expert at servers in any way! (we are web app ...
2 votes
3 answers
938 views

Why could query performance improve enormous after db restore on new server with worse hardware?

A asp.net page doing very slow to load a list from SQL Server has increased it's performance very much after the whole database has been restored on a new SQL Server. The asp.net app has moved from ...
35 votes
4 answers
29k views

CPU clock speed versus CPU core count - higher GHz, or more cores for SQL Server?

We are beginning to provision a set of physical servers for a virtual cluster of SQL Server 2016 nodes within VMware. We will be utilizing Enterprise Edition licenses. We plan on setting up 6 nodes, ...
15 votes
1 answer
2k views

Does SQL Server 2017, including older versions, support 8k disk sector sizes?

Disk (loosely worded to include not only rotational media but non-rotational media [SSD, NVMe, etc.]) drives are continuing to evolve in their underlying formats and hardware. Part of this was an "...
30 votes
4 answers
8k views

Do SSDs reduce the usefulness of Databases

I only heard about Robert Martin today, and it seems like he's a notable figure in the software world, so I don't mean for my title to appear as if it's a click bait or me putting words in his mouth, ...
2 votes
2 answers
742 views

Multiple instance properties

I'd like to understand how tuning works on instances that are living inside the same machine/VM. I couldn't find a straight answer to the question if properties of each separate instance have some ...
0 votes
1 answer
445 views

How important is drive speed for a MySql server

I'm trying to invest in a self managed server for MySQL. My use case will involve querying a full text index of anywhere from 5m to 20m records. About 5 thousand full text searches per hour. Usually ...
0 votes
2 answers
986 views

What hardware to purchase for MySQL server? Details below [closed]

I am planning to build a basic server machine dedicated to running MySQL for my small business. What I need the database for... I will be setting up a database to hold records of registered voters in ...
-1 votes
1 answer
174 views

How do I find the number of cores needed for CPU if I know the expected transactions per second? [closed]

We are in a scenario where we have a rough idea regarding the expected number of transactions per second in the database server. We don't have the actual (custom built) software in hand. When planning ...
0 votes
1 answer
268 views

SSD used for tablespace died. How can I recover data?

I have a postgres cluster with two databases Database A uses the default tablespace. It holds important information but has very few writes per day (< 20) and only has a few tables with a few ...
0 votes
1 answer
189 views

Estimated hardware requirement for a planned "mostly-write" database

I was asked to create a server application that needs to receive and store relatively simply messages (about 7 fields, uints, strings and a timestamp), but a lot of them and at a high frequency. The ...
1 vote
2 answers
1k views

SQL Server Virtualization best practices - NUMA, HT, Cores vs Speed

We run on Cisco UCS + VMware ESX + HP 3PAR. Host blade config : UCSB-B200-M4 , Xeon E5-2667 v3 3.1GHz , 2 sockets , 8 cores each, Hyper-Threading Active So total 16 physical cores, or 32 logical ...
2 votes
1 answer
44 views

Help on building a new Server [closed]

I am in the process of building a new server to run our SQL Server databases (we have many TB's of data). I am looking for some help on what I should request for hard drives. My thought was to have 5 ...
2 votes
2 answers
262 views

How to spec a machine for a particular database load?

Our primary authentication database that is used for 100k+ users, and growing is a VM on a shared machine that we want to extract into its own isolated hardware. This will let us isolate resources, ...
4 votes
0 answers
100 views

What DBMS to choose for my production environment? [closed]

This is my very first question on the StackExchange/StackOverflow community. I originally am an electrical engineer so I hope you bear with me. I need to set up a database whose purpose is to be ...
3 votes
1 answer
2k views

32GB RAM needed to work with 200.000.000 rows in MongoDB?

I've been playing with a large dataset, consisting of a few tens of billions of rows of small ascii strings. I want to count the number of occurrences of each string in the dataset, and i suspect the ...
2 votes
1 answer
473 views

Performance of mysql equi-join observed in HDD and SSD

I experimented performance of queries having equi-joins. I have simplified version of EXPLAINs of the queries. Mysql version : 5.7.18 Engine : Innodb Cache state : Mysql restarted before experiment ...
0 votes
1 answer
130 views

DB server VM's CPU configuration - 1x2Ghz or 2x1Ghz - which is better

We want to set up DB server in cloud hosting for MS SQL Server Express edition - OLTP workload for "just" 6 concurent users - mostly short and small transactions. Hosting company is charging each ...
-1 votes
2 answers
3k views

Mariadb minimum CPU requirements (Edit: Still crashing, new question with log linked)

EDIT3: Read-write splitting seems the answer as pointed by out the user dbdemon in the linked question. Internal MariaDB error code: 1927 ('Connection was killed') EDIT2: https://drupal....
0 votes
0 answers
241 views

Very slow disk readind on postgres server

I hava a server for postgres only, its very slow reading on hd, something about 16mb/s or less, checked in iotop while a server overload. Two scsi disks, i have to check every information by ssh, my ...
2 votes
1 answer
975 views

Disk Architecture on SQL Server [closed]

I am building a new environment using the SQL Server 2017 Always-On system. This will be active 24/7 and there will be lots of DML processes. I have a 100GB SAS for the OS, a 1TB SAS for Data and a ...
0 votes
2 answers
70 views

Application on Different SQL Servers

In a Sql note "you should never put applications in each other's way if you do not have to.. Applications sharing memory, CPUs, internal tempdb can cause an issue. One application submitting a ...
1 vote
1 answer
958 views

Which hard disks for PostgreSQL? [closed]

The size of the our PostgreSQL data directory is 100 GByte. Up to now we use traditional hard disk drives and hardware RAID 10. Which hard disk drives and RAID setup would give us maximum ...
1 vote
3 answers
186 views

SQL SSIS Internal ETL at Company

Business Departments at our Finance company want IT to import various spreadsheets (companyid, productid, balance, transactions) into the databases. Lets say, the SQL physical server harddrive ...
0 votes
2 answers
4k views

SQL SSIS Closing Files already in use

Sometimes when running SSIS packages on flat files, I receive error: "The process cannot access the file because it is being used by another process". Another person already has file opened. Is ...
14 votes
2 answers
9k views

More CPU cores vs faster disks

I'm part of a small company so as usual covering a number of different roles. The latest of which is procuring a dedicated SQL Server box for our .NET web app. We've been quoted on a dual Xeon E5-2620 ...
16 votes
1 answer
6k views

How to go about extending volumes on SQL Server boxes?

Here is a question for the sys ops out there (or those who have gone through this experience before). My company wants to allocate additional disk space on existing SQL Server boxes in production. ...
2 votes
1 answer
385 views

SQL Server Hardware Specs for Analyzing TBs of Data

I am building a workstation with the purpose of analyzing multiple terabytes of data. Hundreds of tables, hundreds of columns, various data types throughout. This will include slicing-and-dicing the ...
0 votes
1 answer
601 views

Memory speed vs. amount [closed]

I just got talking to DBA as he asked me: What's best, memory speed or memory amount, e.g. 512GB @ 1866MHz or 768GB @ 1333MHz, when running the database in-memory? We've both been looking for stats, ...
20 votes
5 answers
21k views

Optimal drive configuration for SQL Server 2008R2

I have a fairly busy database server running SQL Server 2008 R2 that has the following setup: SATA RAID 1 (2 Drives) - OS / Programs SAS RAID 10 (4 Drives) - Sql Database Files (data and logs) SAS ...
5 votes
2 answers
5k views

SSDs and 64K sectors

SSDs tend to have a natural 4K sector size as far as I know, but would it be beneficial to format Windows cluster size at 64K? This is good practice for spinning rust, but is it relevant on SSDs?
-2 votes
2 answers
2k views

SQL Server build

We are building a new server at work and I'm hoping to get ideas of how we should build it out for optimum performance and back-up capability. We have 6 drives and we need to have an OS (Windows ...
1 vote
1 answer
450 views

Processors: E5-4620 v2 vs E5-2620 v3 [closed]

We're debating between: R820 - E5-4620 v2 - 2.6GHz - 8 cores, 20MB Cache, 1333MHz max memory speed - max of 768GB ram - 8 core R730 - E5-2620 v3 - 2.4GHz - 6 cores, 15MB Cache, 1866MHz max memory ...
2 votes
1 answer
312 views

MySQL Hardware Bottleneck

I have a web application that makes simple queries to a MySQL database. The database is quite large (8.4GB) and the time to lookup an entry needs to be as fast as possible. The database represents a ...
2 votes
2 answers
666 views

PostgreSQL on Desktop vs. Server

How does running PostgreSQL on a Windows desktop with pgAdmin III compare to running it on a dedicated server? I am trying to develop a database with very large tables (~60 million rows) with the ...
5 votes
3 answers
3k views

Single Virtual Drive Vs Multiple Virtual Drives for SQL Server files

Hi guys I have question about how two different Hard disk setups can possibly affect performance of my database. I have two Options. Option 1: One Physical Harddisk and then Multiple Virtual hard ...
3 votes
1 answer
3k views

SQL Server recommended MAXDOP settings for NUMA

I have an OLTP SQL Database running on SQL 2008 R2 Enterprise Edition that may be fairly busy (5000 batches/sec) in next couple of months after going live production. Looking into server configuration ...
0 votes
1 answer
231 views

intel p3600 SSD no increase in read speed - postgres rdbms vs hdd

We run a custom application that produces analyzable data-sets for medical research. the amount of data we have is about 600GB in form 3Billion rows distributed in 600+ tables it is hosted in ...
11 votes
1 answer
14k views

How do you calculate how much hardware resources you need for a database?

We are in the process of scaling our database servers. I was wondering how should we calculate how much hardware resources we need for our databases? Here is a little bit information about our ...