Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [hardware]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
26 views

Postgres DISK IO very high

I have very little experience in database administration, so I would like to ask you for help. I'm working on a home project that collects product information from one of the marketplaces. I'm ...
Dudoserg's user avatar
0 votes
2 answers
37 views

Understanding Secondary Log Hard Disk Impact on Write Speed and Data Integrity After Power Outage

I've recently come across the notion that a secondary log hard disk can be employed to enhance write operation speed in a database system. I find this concept intriguing but am struggling to grasp the ...
cricket900's user avatar
0 votes
1 answer
43 views

What is a common type of storage hardware for dedicated MySQL servers? [closed]

I am curious what kind of storage hardware is common to see in servers that are dedicated for MySQL ? For example online services like Amazon AWS, Azure, Google, etc that offer(ed) dedicated mysql ...
adrianTNT's user avatar
  • 195
0 votes
1 answer
80 views

How to tell if a MySQL query speed is bottlenecked by storage or CPU speed?

Using MySQL 8.0.30 on Rocky Linux 9 For slow MySQL queries in general, not for a speciffic one, is there a way to tell if query speed was bottlenecked by storage speed, cpu speed, or maybe even ram ...
adrianTNT's user avatar
  • 195
0 votes
1 answer
37 views

Minimizing MySQL full text query times on news database

I have a MySQL Database of 250,000 news articles. With time, it's size will continue to increase by at least 250,000 articles per year. I'm doing full text searches on this database to find articles ...
Jimmison Johnson's user avatar
0 votes
2 answers
418 views

High Load MariaDB Cluster (Galera Multi Master Replication) - Same hardware needed for Slaves?

My Galera Cluster is on very high load. To run it fine, I´m using strong hardware and for sure a lot of custom MariaDB settings and custom OS tweaks. Now, I want to add Slaves to get "realtime&...
DLLDevStudio's user avatar
0 votes
1 answer
68 views

Dell Server Raid 1 drive quick replacement with 2 exact copies

Apologies if I am posting this to the wrong place. We are unfortunately having to handle our own server administration in-house and no one here is an expert at servers in any way! (we are web app ...
CapnElectric's user avatar
2 votes
2 answers
762 views

Multiple instance properties

I'd like to understand how tuning works on instances that are living inside the same machine/VM. I couldn't find a straight answer to the question if properties of each separate instance have some ...
ieronymous's user avatar
0 votes
1 answer
480 views

How important is drive speed for a MySql server

I'm trying to invest in a self managed server for MySQL. My use case will involve querying a full text index of anywhere from 5m to 20m records. About 5 thousand full text searches per hour. Usually ...
Justin Schievenin's user avatar
0 votes
2 answers
1k views

What hardware to purchase for MySQL server? Details below [closed]

I am planning to build a basic server machine dedicated to running MySQL for my small business. What I need the database for... I will be setting up a database to hold records of registered voters in ...
Justin Schievenin's user avatar
-1 votes
1 answer
181 views

How do I find the number of cores needed for CPU if I know the expected transactions per second? [closed]

We are in a scenario where we have a rough idea regarding the expected number of transactions per second in the database server. We don't have the actual (custom built) software in hand. When planning ...
Masroor's user avatar
  • 99
0 votes
1 answer
271 views

SSD used for tablespace died. How can I recover data?

I have a postgres cluster with two databases Database A uses the default tablespace. It holds important information but has very few writes per day (< 20) and only has a few tables with a few ...
sheepdog's user avatar
  • 345
0 votes
1 answer
195 views

Estimated hardware requirement for a planned "mostly-write" database

I was asked to create a server application that needs to receive and store relatively simply messages (about 7 fields, uints, strings and a timestamp), but a lot of them and at a high frequency. The ...
Rob's user avatar
  • 119
2 votes
1 answer
44 views

Help on building a new Server [closed]

I am in the process of building a new server to run our SQL Server databases (we have many TB's of data). I am looking for some help on what I should request for hard drives. My thought was to have 5 ...
Mike S's user avatar
  • 121
4 votes
0 answers
100 views

What DBMS to choose for my production environment? [closed]

This is my very first question on the StackExchange/StackOverflow community. I originally am an electrical engineer so I hope you bear with me. I need to set up a database whose purpose is to be ...
ryancooper73's user avatar
3 votes
1 answer
2k views

32GB RAM needed to work with 200.000.000 rows in MongoDB?

I've been playing with a large dataset, consisting of a few tens of billions of rows of small ascii strings. I want to count the number of occurrences of each string in the dataset, and i suspect the ...
user37203's user avatar
  • 141
15 votes
1 answer
2k views

Does SQL Server 2017, including older versions, support 8k disk sector sizes?

Disk (loosely worded to include not only rotational media but non-rotational media [SSD, NVMe, etc.]) drives are continuing to evolve in their underlying formats and hardware. Part of this was an "...
Sean Gallardy's user avatar
2 votes
1 answer
474 views

Performance of mysql equi-join observed in HDD and SSD

I experimented performance of queries having equi-joins. I have simplified version of EXPLAINs of the queries. Mysql version : 5.7.18 Engine : Innodb Cache state : Mysql restarted before experiment ...
Dinesh Kumar's user avatar
0 votes
1 answer
131 views

DB server VM's CPU configuration - 1x2Ghz or 2x1Ghz - which is better

We want to set up DB server in cloud hosting for MS SQL Server Express edition - OLTP workload for "just" 6 concurent users - mostly short and small transactions. Hosting company is charging each ...
jericzech's user avatar
  • 945
2 votes
2 answers
264 views

How to spec a machine for a particular database load?

Our primary authentication database that is used for 100k+ users, and growing is a VM on a shared machine that we want to extract into its own isolated hardware. This will let us isolate resources, ...
basedrum1's user avatar
0 votes
2 answers
883 views

Handling Bus Error in Mongo Service

I have a Mongo service with which multiple hosts are interacting. The host on which the Mongo service is running is quite special -- it has 3TB of RAM. However, that host also throws intermittent Bus ...
duhaime's user avatar
  • 129
0 votes
0 answers
245 views

Very slow disk readind on postgres server

I hava a server for postgres only, its very slow reading on hd, something about 16mb/s or less, checked in iotop while a server overload. Two scsi disks, i have to check every information by ssh, my ...
Tiago Oliveira de Freitas's user avatar
2 votes
1 answer
996 views

Disk Architecture on SQL Server [closed]

I am building a new environment using the SQL Server 2017 Always-On system. This will be active 24/7 and there will be lots of DML processes. I have a 100GB SAS for the OS, a 1TB SAS for Data and a ...
S. Doe's user avatar
  • 58
0 votes
2 answers
70 views

Application on Different SQL Servers

In a Sql note "you should never put applications in each other's way if you do not have to.. Applications sharing memory, CPUs, internal tempdb can cause an issue. One application submitting a ...
user avatar
-1 votes
2 answers
3k views

Mariadb minimum CPU requirements (Edit: Still crashing, new question with log linked)

EDIT3: Read-write splitting seems the answer as pointed by out the user dbdemon in the linked question. Internal MariaDB error code: 1927 ('Connection was killed') EDIT2: https://drupal....
a_at_cyber_dot_training's user avatar
1 vote
1 answer
986 views

Which hard disks for PostgreSQL? [closed]

The size of the our PostgreSQL data directory is 100 GByte. Up to now we use traditional hard disk drives and hardware RAID 10. Which hard disk drives and RAID setup would give us maximum ...
guettli's user avatar
  • 1,521
0 votes
2 answers
4k views

SQL SSIS Closing Files already in use

Sometimes when running SSIS packages on flat files, I receive error: "The process cannot access the file because it is being used by another process". Another person already has file opened. Is ...
user avatar
1 vote
3 answers
186 views

SQL SSIS Internal ETL at Company

Business Departments at our Finance company want IT to import various spreadsheets (companyid, productid, balance, transactions) into the databases. Lets say, the SQL physical server harddrive ...
user avatar
15 votes
1 answer
7k views

How to go about extending volumes on SQL Server boxes?

Here is a question for the sys ops out there (or those who have gone through this experience before). My company wants to allocate additional disk space on existing SQL Server boxes in production. ...
Martin Surasky's user avatar
2 votes
1 answer
388 views

SQL Server Hardware Specs for Analyzing TBs of Data

I am building a workstation with the purpose of analyzing multiple terabytes of data. Hundreds of tables, hundreds of columns, various data types throughout. This will include slicing-and-dicing the ...
user3788403's user avatar
35 votes
4 answers
29k views

CPU clock speed versus CPU core count - higher GHz, or more cores for SQL Server?

We are beginning to provision a set of physical servers for a virtual cluster of SQL Server 2016 nodes within VMware. We will be utilizing Enterprise Edition licenses. We plan on setting up 6 nodes, ...
PicoDeGallo's user avatar
  • 1,564
0 votes
1 answer
612 views

Memory speed vs. amount [closed]

I just got talking to DBA as he asked me: What's best, memory speed or memory amount, e.g. 512GB @ 1866MHz or 768GB @ 1333MHz, when running the database in-memory? We've both been looking for stats, ...
DanielV's user avatar
30 votes
4 answers
8k views

Do SSDs reduce the usefulness of Databases

I only heard about Robert Martin today, and it seems like he's a notable figure in the software world, so I don't mean for my title to appear as if it's a click bait or me putting words in his mouth, ...
Honinbo Shusaku's user avatar
5 votes
2 answers
6k views

SSDs and 64K sectors

SSDs tend to have a natural 4K sector size as far as I know, but would it be beneficial to format Windows cluster size at 64K? This is good practice for spinning rust, but is it relevant on SSDs?
John Alan's user avatar
  • 1,071
1 vote
2 answers
1k views

SQL Server Virtualization best practices - NUMA, HT, Cores vs Speed

We run on Cisco UCS + VMware ESX + HP 3PAR. Host blade config : UCSB-B200-M4 , Xeon E5-2667 v3 3.1GHz , 2 sockets , 8 cores each, Hyper-Threading Active So total 16 physical cores, or 32 logical ...
d-_-b's user avatar
  • 1,154
2 votes
2 answers
669 views

PostgreSQL on Desktop vs. Server

How does running PostgreSQL on a Windows desktop with pgAdmin III compare to running it on a dedicated server? I am trying to develop a database with very large tables (~60 million rows) with the ...
user101007's user avatar
0 votes
1 answer
233 views

intel p3600 SSD no increase in read speed - postgres rdbms vs hdd

We run a custom application that produces analyzable data-sets for medical research. the amount of data we have is about 600GB in form 3Billion rows distributed in 600+ tables it is hosted in ...
krisGoks's user avatar
2 votes
3 answers
969 views

Why could query performance improve enormous after db restore on new server with worse hardware?

A asp.net page doing very slow to load a list from SQL Server has increased it's performance very much after the whole database has been restored on a new SQL Server. The asp.net app has moved from ...
Magier's user avatar
  • 4,787
2 votes
1 answer
313 views

MySQL Hardware Bottleneck

I have a web application that makes simple queries to a MySQL database. The database is quite large (8.4GB) and the time to lookup an entry needs to be as fast as possible. The database represents a ...
user avatar
11 votes
1 answer
14k views

How do you calculate how much hardware resources you need for a database?

We are in the process of scaling our database servers. I was wondering how should we calculate how much hardware resources we need for our databases? Here is a little bit information about our ...
Mahdi's user avatar
  • 175
1 vote
1 answer
1k views

Hardware specs for MySQL database with millions of records

For 35 million records I have this table CREATE TABLE IF NOT EXISTS `records` ( `code` varchar(12) NOT NULL, `type` varchar(255) NOT NULL, `used` set('y','n') NOT NULL default 'n', PRIMARY ...
Juan Pablo Rodriguez's user avatar
1 vote
1 answer
148 views

MongoLab: Does hardware effect performance of a find() query [closed]

I asked a pervious question on StackOverflow about if document size affected the performance of fetching that document (the document is 3MB in size) https://stackoverflow.com/questions/30226219/does-...
SNV7's user avatar
  • 111
1 vote
1 answer
450 views

Processors: E5-4620 v2 vs E5-2620 v3 [closed]

We're debating between: R820 - E5-4620 v2 - 2.6GHz - 8 cores, 20MB Cache, 1333MHz max memory speed - max of 768GB ram - 8 core R730 - E5-2620 v3 - 2.4GHz - 6 cores, 15MB Cache, 1866MHz max memory ...
Dan Andrews's user avatar
0 votes
1 answer
3k views

Database storage limit for open source PostgresSQL

I just started using PostgresSQL. When I installed SQL Server Express years back, you typically had a database storage limit if you didn't install the full version. I think I remember it being 4GB, ...
JustBeingHelpful's user avatar
2 votes
1 answer
689 views

SQL Hard Drive Config?

I am setting up new server and am a little confused in my research of HD configuration. My main question is : Is it recommended to have the Trans Logs and DB logs (ldf) on separate spindles or can ...
PBK's user avatar
  • 51
2 votes
1 answer
1k views

Using Aerospike without SSD [closed]

Is there a drawback for using Aerospike when used in non-SSD server?
Kokizzu's user avatar
  • 1,373
5 votes
3 answers
3k views

Single Virtual Drive Vs Multiple Virtual Drives for SQL Server files

Hi guys I have question about how two different Hard disk setups can possibly affect performance of my database. I have two Options. Option 1: One Physical Harddisk and then Multiple Virtual hard ...
M.Ali's user avatar
  • 1,960
0 votes
1 answer
84 views

Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? [closed]

Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? I am researching SQLOS and how threads and scheduling are handled, but I would ...
Eric Swiggum's user avatar
0 votes
1 answer
222 views

sql server disk I/o question [closed]

I have a question on disks. How much I/O can a normal disk and a SAN disk can handle? I have heard about SAN disks should be able to handle upto 200-300 mb/sec, how much does a normal disk can handle ...
user31563's user avatar
  • 157
0 votes
0 answers
299 views

Overcoming the HDD IOPS limits on a billion row table? Is getting SSD the only solution?

I have a table with this structure: CREATE TABLE `requests` ( `userid` int(11) NOT NULL, `messageid` int(11) NOT NULL, `queueid` int(11) NOT NULL AUTO_INCREMENT, `problem_id` int(3) NOT NULL, `...
user3010273's user avatar