Questions tagged [hardware]
The hardware tag has no usage guidance.
80
questions
-2
votes
1
answer
29
views
Guidance on how to assess the impact of multiple parallel SELECT queries
Setup: SQL Server 2019 on Azure VM.
We have an application that, on a specific date, will execute multiple queries to load data into their system. These queries will be run via Databricks using an ...
- 351
0
votes
0
answers
53
views
Postgres DISK IO very high
I have very little experience in database administration, so I would like to ask you for help. I'm working on a home project that collects product information from one of the marketplaces.
I'm ...
- 9
0
votes
2
answers
38
views
Understanding Secondary Log Hard Disk Impact on Write Speed and Data Integrity After Power Outage
I've recently come across the notion that a secondary log hard disk can be employed to enhance write operation speed in a database system. I find this concept intriguing but am struggling to grasp the ...
- 135
0
votes
1
answer
47
views
What is a common type of storage hardware for dedicated MySQL servers? [closed]
I am curious what kind of storage hardware is common to see in servers that are dedicated for MySQL ? For example online services like Amazon AWS, Azure, Google, etc that offer(ed) dedicated mysql ...
- 194
0
votes
1
answer
101
views
How to tell if a MySQL query speed is bottlenecked by storage or CPU speed?
Using MySQL 8.0.30 on Rocky Linux 9
For slow MySQL queries in general, not for a speciffic one, is there a way to tell if query speed was bottlenecked by storage speed, cpu speed, or maybe even ram ...
- 194
0
votes
1
answer
39
views
Minimizing MySQL full text query times on news database
I have a MySQL Database of 250,000 news articles. With time, it's size will continue to increase by at least 250,000 articles per year.
I'm doing full text searches on this database to find articles ...
0
votes
2
answers
441
views
High Load MariaDB Cluster (Galera Multi Master Replication) - Same hardware needed for Slaves?
My Galera Cluster is on very high load.
To run it fine, I´m using strong hardware and for sure a lot of custom MariaDB settings and custom OS tweaks.
Now, I want to add Slaves to get "realtime&...
0
votes
1
answer
69
views
Dell Server Raid 1 drive quick replacement with 2 exact copies
Apologies if I am posting this to the wrong place.
We are unfortunately having to handle our own server administration in-house and no one here is an expert at servers in any way! (we are web app ...
2
votes
2
answers
797
views
Multiple instance properties
I'd like to understand how tuning works on instances that are living inside the same machine/VM.
I couldn't find a straight answer to the question if properties of each separate instance have some ...
- 29
0
votes
1
answer
539
views
How important is drive speed for a MySql server
I'm trying to invest in a self managed server for MySQL. My use case will involve querying a full text index of anywhere from 5m to 20m records. About 5 thousand full text searches per hour. Usually ...
0
votes
2
answers
1k
views
What hardware to purchase for MySQL server? Details below [closed]
I am planning to build a basic server machine dedicated to running MySQL for my small business.
What I need the database for...
I will be setting up a database to hold records of registered voters in ...
-1
votes
1
answer
197
views
How do I find the number of cores needed for CPU if I know the expected transactions per second? [closed]
We are in a scenario where we have a rough idea regarding the expected number of transactions per second in the database server. We don't have the actual (custom built) software in hand.
When planning ...
- 99
0
votes
1
answer
275
views
SSD used for tablespace died. How can I recover data?
I have a postgres cluster with two databases
Database A uses the default tablespace. It holds important information but has very few writes per day (< 20) and only has a few tables with a few ...
- 345
0
votes
1
answer
211
views
Estimated hardware requirement for a planned "mostly-write" database
I was asked to create a server application that needs to receive and store relatively simply messages (about 7 fields, uints, strings and a timestamp), but a lot of them and at a high frequency. The ...
- 119
2
votes
1
answer
44
views
Help on building a new Server [closed]
I am in the process of building a new server to run our SQL Server databases (we have many TB's of data). I am looking for some help on what I should request for hard drives. My thought was to have 5 ...
- 121
4
votes
0
answers
101
views
What DBMS to choose for my production environment? [closed]
This is my very first question on the StackExchange/StackOverflow community. I originally am an electrical engineer so I hope you bear with me.
I need to set up a database whose purpose is to be ...
- 41
3
votes
1
answer
2k
views
32GB RAM needed to work with 200.000.000 rows in MongoDB?
I've been playing with a large dataset, consisting of a few tens of billions of rows of small ascii strings. I want to count the number of occurrences of each string in the dataset, and i suspect the ...
- 141
15
votes
1
answer
2k
views
Does SQL Server 2017, including older versions, support 8k disk sector sizes?
Disk (loosely worded to include not only rotational media but non-rotational media [SSD, NVMe, etc.]) drives are continuing to evolve in their underlying formats and hardware. Part of this was an "...
- 34.9k
2
votes
1
answer
480
views
Performance of mysql equi-join observed in HDD and SSD
I experimented performance of queries having equi-joins. I have simplified version of EXPLAINs of the queries.
Mysql version : 5.7.18
Engine : Innodb
Cache state : Mysql restarted before experiment ...
- 664
0
votes
1
answer
135
views
DB server VM's CPU configuration - 1x2Ghz or 2x1Ghz - which is better
We want to set up DB server in cloud hosting for MS SQL Server Express edition - OLTP workload for "just" 6 concurent users - mostly short and small transactions.
Hosting company is charging each ...
- 945
2
votes
2
answers
271
views
How to spec a machine for a particular database load?
Our primary authentication database that is used for 100k+ users, and growing is a VM on a shared machine that we want to extract into its own isolated hardware. This will let us isolate resources, ...
- 21
0
votes
2
answers
904
views
Handling Bus Error in Mongo Service
I have a Mongo service with which multiple hosts are interacting. The host on which the Mongo service is running is quite special -- it has 3TB of RAM. However, that host also throws intermittent Bus ...
- 129
0
votes
0
answers
254
views
Very slow disk readind on postgres server
I hava a server for postgres only, its very slow reading on hd, something about 16mb/s or less, checked in iotop while a server overload.
Two scsi disks, i have to check every information by ssh, my ...
2
votes
1
answer
1k
views
Disk Architecture on SQL Server [closed]
I am building a new environment using the SQL Server 2017 Always-On system.
This will be active 24/7 and there will be lots of DML processes.
I have a 100GB SAS for the OS, a 1TB SAS for Data and a ...
- 58
0
votes
2
answers
71
views
Application on Different SQL Servers
In a Sql note "you should never put applications in each other's way if you do not have to.. Applications sharing memory, CPUs, internal tempdb can cause an issue. One application submitting a ...
user129291
-1
votes
2
answers
3k
views
Mariadb minimum CPU requirements (Edit: Still crashing, new question with log linked)
EDIT3: Read-write splitting seems the answer as pointed by out the user dbdemon in the linked question.
Internal MariaDB error code: 1927 ('Connection was killed')
EDIT2: https://drupal....
1
vote
1
answer
1k
views
Which hard disks for PostgreSQL? [closed]
The size of the our PostgreSQL data directory is 100 GByte.
Up to now we use traditional hard disk drives and hardware RAID 10.
Which hard disk drives and RAID setup would give us maximum ...
- 1,551
0
votes
2
answers
4k
views
SQL SSIS Closing Files already in use
Sometimes when running SSIS packages on flat files, I receive error: "The process cannot access the file because it is being used by another process".
Another person already has file opened.
Is ...
user129291
1
vote
3
answers
187
views
SQL SSIS Internal ETL at Company
Business Departments at our Finance company want IT to import various spreadsheets (companyid, productid, balance, transactions) into the databases.
Lets say, the SQL physical server harddrive ...
user129291
15
votes
1
answer
7k
views
How to go about extending volumes on SQL Server boxes?
Here is a question for the sys ops out there (or those who have gone through this experience before).
My company wants to allocate additional disk space on existing SQL Server boxes in production. ...
- 773
2
votes
1
answer
401
views
SQL Server Hardware Specs for Analyzing TBs of Data
I am building a workstation with the purpose of analyzing multiple terabytes of data. Hundreds of tables, hundreds of columns, various data types throughout. This will include slicing-and-dicing the ...
- 21
35
votes
4
answers
29k
views
CPU clock speed versus CPU core count - higher GHz, or more cores for SQL Server?
We are beginning to provision a set of physical servers for a virtual cluster of SQL Server 2016 nodes within VMware. We will be utilizing Enterprise Edition licenses.
We plan on setting up 6 nodes, ...
- 1,564
0
votes
1
answer
631
views
Memory speed vs. amount [closed]
I just got talking to DBA as he asked me: What's best, memory speed or memory amount, e.g. 512GB @ 1866MHz or 768GB @ 1333MHz, when running the database in-memory?
We've both been looking for stats, ...
- 1
30
votes
4
answers
8k
views
Do SSDs reduce the usefulness of Databases
I only heard about Robert Martin today, and it seems like he's a notable figure in the software world, so I don't mean for my title to appear as if it's a click bait or me putting words in his mouth, ...
- 499
5
votes
2
answers
6k
views
SSDs and 64K sectors
SSDs tend to have a natural 4K sector size as far as I know, but would it be beneficial to format Windows cluster size at 64K? This is good practice for spinning rust, but is it relevant on SSDs?
- 1,071
1
vote
2
answers
1k
views
SQL Server Virtualization best practices - NUMA, HT, Cores vs Speed
We run on Cisco UCS + VMware ESX + HP 3PAR.
Host blade config :
UCSB-B200-M4 , Xeon E5-2667 v3 3.1GHz , 2 sockets , 8 cores each, Hyper-Threading Active
So total 16 physical cores, or 32 logical ...
- 1,164
2
votes
2
answers
679
views
PostgreSQL on Desktop vs. Server
How does running PostgreSQL on a Windows desktop with pgAdmin III compare to running it on a dedicated server? I am trying to develop a database with very large tables (~60 million rows) with the ...
- 21
0
votes
1
answer
233
views
intel p3600 SSD no increase in read speed - postgres rdbms vs hdd
We run a custom application that produces analyzable data-sets for medical research.
the amount of data we have is about 600GB in form 3Billion rows distributed in 600+ tables it is hosted in ...
- 1
2
votes
3
answers
1k
views
Why could query performance improve enormous after db restore on new server with worse hardware?
A asp.net page doing very slow to load a list from SQL Server has increased it's performance very much after the whole database has been restored on a new SQL Server. The asp.net app has moved from ...
- 4,797
2
votes
1
answer
315
views
MySQL Hardware Bottleneck
I have a web application that makes simple queries to a MySQL database. The database is quite large (8.4GB) and the time to lookup an entry needs to be as fast as possible.
The database represents a ...
Robert Hosking
12
votes
1
answer
14k
views
How do you calculate how much hardware resources you need for a database?
We are in the process of scaling our database servers. I was wondering how should we calculate how much hardware resources we need for our databases?
Here is a little bit information about our ...
- 185
1
vote
1
answer
1k
views
Hardware specs for MySQL database with millions of records
For 35 million records I have this table
CREATE TABLE IF NOT EXISTS `records` (
`code` varchar(12) NOT NULL,
`type` varchar(255) NOT NULL,
`used` set('y','n') NOT NULL default 'n',
PRIMARY ...
1
vote
1
answer
148
views
MongoLab: Does hardware effect performance of a find() query [closed]
I asked a pervious question on StackOverflow about if document size affected the performance of fetching that document (the document is 3MB in size)
https://stackoverflow.com/questions/30226219/does-...
- 111
1
vote
1
answer
452
views
Processors: E5-4620 v2 vs E5-2620 v3 [closed]
We're debating between:
R820 - E5-4620 v2 - 2.6GHz - 8 cores, 20MB Cache, 1333MHz max memory speed - max of 768GB ram - 8 core
R730 - E5-2620 v3 - 2.4GHz - 6 cores, 15MB Cache, 1866MHz max memory ...
- 204
0
votes
1
answer
3k
views
Database storage limit for open source PostgresSQL
I just started using PostgresSQL. When I installed SQL Server Express years back, you typically had a database storage limit if you didn't install the full version. I think I remember it being 4GB, ...
- 2,092
2
votes
1
answer
689
views
SQL Hard Drive Config?
I am setting up new server and am a little confused in my research of HD configuration. My main question is :
Is it recommended to have the Trans Logs and DB logs (ldf) on separate spindles or can ...
- 51
2
votes
1
answer
1k
views
Using Aerospike without SSD [closed]
Is there a drawback for using Aerospike when used in non-SSD server?
- 1,373
5
votes
3
answers
3k
views
Single Virtual Drive Vs Multiple Virtual Drives for SQL Server files
Hi guys I have question about how two different Hard disk setups can possibly affect performance of my database.
I have two Options.
Option 1:
One Physical Harddisk and then Multiple Virtual hard ...
- 1,970
0
votes
1
answer
85
views
Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? [closed]
Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)?
I am researching SQLOS and how threads and scheduling are handled, but I would ...
- 620
0
votes
1
answer
222
views
sql server disk I/o question [closed]
I have a question on disks.
How much I/O can a normal disk and a SAN disk can handle?
I have heard about SAN disks should be able to handle upto 200-300 mb/sec, how much does a normal disk can handle ...
- 157