Questions tagged [hardware]
The hardware tag has no usage guidance.
79
questions
0
votes
2
answers
406
views
High Load MariaDB Cluster (Galera Multi Master Replication) - Same hardware needed for Slaves?
My Galera Cluster is on very high load.
To run it fine, I´m using strong hardware and for sure a lot of custom MariaDB settings and custom OS tweaks.
Now, I want to add Slaves to get "realtime&...
0
votes
0
answers
24
views
Postgres DISK IO very high
I have very little experience in database administration, so I would like to ask you for help. I'm working on a home project that collects product information from one of the marketplaces.
I'm ...
0
votes
2
answers
869
views
Handling Bus Error in Mongo Service
I have a Mongo service with which multiple hosts are interacting. The host on which the Mongo service is running is quite special -- it has 3TB of RAM. However, that host also throws intermittent Bus ...
0
votes
2
answers
36
views
Understanding Secondary Log Hard Disk Impact on Write Speed and Data Integrity After Power Outage
I've recently come across the notion that a secondary log hard disk can be employed to enhance write operation speed in a database system. I find this concept intriguing but am struggling to grasp the ...
0
votes
1
answer
43
views
What is a common type of storage hardware for dedicated MySQL servers? [closed]
I am curious what kind of storage hardware is common to see in servers that are dedicated for MySQL ? For example online services like Amazon AWS, Azure, Google, etc that offer(ed) dedicated mysql ...
2
votes
1
answer
686
views
SQL Hard Drive Config?
I am setting up new server and am a little confused in my research of HD configuration. My main question is :
Is it recommended to have the Trans Logs and DB logs (ldf) on separate spindles or can ...
0
votes
1
answer
71
views
How to tell if a MySQL query speed is bottlenecked by storage or CPU speed?
Using MySQL 8.0.30 on Rocky Linux 9
For slow MySQL queries in general, not for a speciffic one, is there a way to tell if query speed was bottlenecked by storage speed, cpu speed, or maybe even ram ...
0
votes
1
answer
35
views
Minimizing MySQL full text query times on news database
I have a MySQL Database of 250,000 news articles. With time, it's size will continue to increase by at least 250,000 articles per year.
I'm doing full text searches on this database to find articles ...
0
votes
1
answer
83
views
Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)? [closed]
Looking for good, but quick references for underlying OS concepts related to SQLOS (Memory Access, Scheduling, etc...)?
I am researching SQLOS and how threads and scheduling are handled, but I would ...
8
votes
1
answer
476
views
Strategies for organising SQL Server with large amount of RAM
We now have a new server for our DB and amongst other things we have 128GB of RAM available (previously I had 16GB) . I know SQL Server is very good at managing it's resources, but I was wondering if ...
16
votes
3
answers
58k
views
SQL Server not using all CPU cores/threads
After upgrading our SQL Server's hardware, we noticed in the Windows Task Manager that the SQL instance is only using half of the threads available to it:
.
The server has the following hardware ...
0
votes
1
answer
66
views
Dell Server Raid 1 drive quick replacement with 2 exact copies
Apologies if I am posting this to the wrong place.
We are unfortunately having to handle our own server administration in-house and no one here is an expert at servers in any way! (we are web app ...
2
votes
3
answers
938
views
Why could query performance improve enormous after db restore on new server with worse hardware?
A asp.net page doing very slow to load a list from SQL Server has increased it's performance very much after the whole database has been restored on a new SQL Server. The asp.net app has moved from ...
35
votes
4
answers
29k
views
CPU clock speed versus CPU core count - higher GHz, or more cores for SQL Server?
We are beginning to provision a set of physical servers for a virtual cluster of SQL Server 2016 nodes within VMware. We will be utilizing Enterprise Edition licenses.
We plan on setting up 6 nodes, ...
15
votes
1
answer
2k
views
Does SQL Server 2017, including older versions, support 8k disk sector sizes?
Disk (loosely worded to include not only rotational media but non-rotational media [SSD, NVMe, etc.]) drives are continuing to evolve in their underlying formats and hardware. Part of this was an "...
30
votes
4
answers
8k
views
Do SSDs reduce the usefulness of Databases
I only heard about Robert Martin today, and it seems like he's a notable figure in the software world, so I don't mean for my title to appear as if it's a click bait or me putting words in his mouth, ...
2
votes
2
answers
742
views
Multiple instance properties
I'd like to understand how tuning works on instances that are living inside the same machine/VM.
I couldn't find a straight answer to the question if properties of each separate instance have some ...
0
votes
1
answer
445
views
How important is drive speed for a MySql server
I'm trying to invest in a self managed server for MySQL. My use case will involve querying a full text index of anywhere from 5m to 20m records. About 5 thousand full text searches per hour. Usually ...
0
votes
2
answers
986
views
What hardware to purchase for MySQL server? Details below [closed]
I am planning to build a basic server machine dedicated to running MySQL for my small business.
What I need the database for...
I will be setting up a database to hold records of registered voters in ...
-1
votes
1
answer
174
views
How do I find the number of cores needed for CPU if I know the expected transactions per second? [closed]
We are in a scenario where we have a rough idea regarding the expected number of transactions per second in the database server. We don't have the actual (custom built) software in hand.
When planning ...
0
votes
1
answer
268
views
SSD used for tablespace died. How can I recover data?
I have a postgres cluster with two databases
Database A uses the default tablespace. It holds important information but has very few writes per day (< 20) and only has a few tables with a few ...
0
votes
1
answer
189
views
Estimated hardware requirement for a planned "mostly-write" database
I was asked to create a server application that needs to receive and store relatively simply messages (about 7 fields, uints, strings and a timestamp), but a lot of them and at a high frequency. The ...
1
vote
2
answers
1k
views
SQL Server Virtualization best practices - NUMA, HT, Cores vs Speed
We run on Cisco UCS + VMware ESX + HP 3PAR.
Host blade config :
UCSB-B200-M4 , Xeon E5-2667 v3 3.1GHz , 2 sockets , 8 cores each, Hyper-Threading Active
So total 16 physical cores, or 32 logical ...
2
votes
1
answer
44
views
Help on building a new Server [closed]
I am in the process of building a new server to run our SQL Server databases (we have many TB's of data). I am looking for some help on what I should request for hard drives. My thought was to have 5 ...
2
votes
2
answers
262
views
How to spec a machine for a particular database load?
Our primary authentication database that is used for 100k+ users, and growing is a VM on a shared machine that we want to extract into its own isolated hardware. This will let us isolate resources, ...
4
votes
0
answers
100
views
What DBMS to choose for my production environment? [closed]
This is my very first question on the StackExchange/StackOverflow community. I originally am an electrical engineer so I hope you bear with me.
I need to set up a database whose purpose is to be ...
3
votes
1
answer
2k
views
32GB RAM needed to work with 200.000.000 rows in MongoDB?
I've been playing with a large dataset, consisting of a few tens of billions of rows of small ascii strings. I want to count the number of occurrences of each string in the dataset, and i suspect the ...
2
votes
1
answer
473
views
Performance of mysql equi-join observed in HDD and SSD
I experimented performance of queries having equi-joins. I have simplified version of EXPLAINs of the queries.
Mysql version : 5.7.18
Engine : Innodb
Cache state : Mysql restarted before experiment ...
0
votes
1
answer
130
views
DB server VM's CPU configuration - 1x2Ghz or 2x1Ghz - which is better
We want to set up DB server in cloud hosting for MS SQL Server Express edition - OLTP workload for "just" 6 concurent users - mostly short and small transactions.
Hosting company is charging each ...
-1
votes
2
answers
3k
views
Mariadb minimum CPU requirements (Edit: Still crashing, new question with log linked)
EDIT3: Read-write splitting seems the answer as pointed by out the user dbdemon in the linked question.
Internal MariaDB error code: 1927 ('Connection was killed')
EDIT2: https://drupal....
0
votes
0
answers
241
views
Very slow disk readind on postgres server
I hava a server for postgres only, its very slow reading on hd, something about 16mb/s or less, checked in iotop while a server overload.
Two scsi disks, i have to check every information by ssh, my ...
2
votes
1
answer
975
views
Disk Architecture on SQL Server [closed]
I am building a new environment using the SQL Server 2017 Always-On system.
This will be active 24/7 and there will be lots of DML processes.
I have a 100GB SAS for the OS, a 1TB SAS for Data and a ...
0
votes
2
answers
70
views
Application on Different SQL Servers
In a Sql note "you should never put applications in each other's way if you do not have to.. Applications sharing memory, CPUs, internal tempdb can cause an issue. One application submitting a ...
1
vote
1
answer
958
views
Which hard disks for PostgreSQL? [closed]
The size of the our PostgreSQL data directory is 100 GByte.
Up to now we use traditional hard disk drives and hardware RAID 10.
Which hard disk drives and RAID setup would give us maximum ...
1
vote
3
answers
186
views
SQL SSIS Internal ETL at Company
Business Departments at our Finance company want IT to import various spreadsheets (companyid, productid, balance, transactions) into the databases.
Lets say, the SQL physical server harddrive ...
0
votes
2
answers
4k
views
SQL SSIS Closing Files already in use
Sometimes when running SSIS packages on flat files, I receive error: "The process cannot access the file because it is being used by another process".
Another person already has file opened.
Is ...
14
votes
2
answers
9k
views
More CPU cores vs faster disks
I'm part of a small company so as usual covering a number of different roles. The latest of which is procuring a dedicated SQL Server box for our .NET web app. We've been quoted on a dual Xeon E5-2620 ...
16
votes
1
answer
6k
views
How to go about extending volumes on SQL Server boxes?
Here is a question for the sys ops out there (or those who have gone through this experience before).
My company wants to allocate additional disk space on existing SQL Server boxes in production. ...
2
votes
1
answer
385
views
SQL Server Hardware Specs for Analyzing TBs of Data
I am building a workstation with the purpose of analyzing multiple terabytes of data. Hundreds of tables, hundreds of columns, various data types throughout. This will include slicing-and-dicing the ...
0
votes
1
answer
601
views
Memory speed vs. amount [closed]
I just got talking to DBA as he asked me: What's best, memory speed or memory amount, e.g. 512GB @ 1866MHz or 768GB @ 1333MHz, when running the database in-memory?
We've both been looking for stats, ...
20
votes
5
answers
21k
views
Optimal drive configuration for SQL Server 2008R2
I have a fairly busy database server running SQL Server 2008 R2 that has the following setup:
SATA RAID 1 (2 Drives) - OS / Programs
SAS RAID 10 (4 Drives) - Sql Database Files (data and logs)
SAS ...
5
votes
2
answers
5k
views
SSDs and 64K sectors
SSDs tend to have a natural 4K sector size as far as I know, but would it be beneficial to format Windows cluster size at 64K? This is good practice for spinning rust, but is it relevant on SSDs?
-2
votes
2
answers
2k
views
SQL Server build
We are building a new server at work and I'm hoping to get ideas of how we should build it out for optimum performance and back-up capability. We have 6 drives and we need to have an OS (Windows ...
1
vote
1
answer
450
views
Processors: E5-4620 v2 vs E5-2620 v3 [closed]
We're debating between:
R820 - E5-4620 v2 - 2.6GHz - 8 cores, 20MB Cache, 1333MHz max memory speed - max of 768GB ram - 8 core
R730 - E5-2620 v3 - 2.4GHz - 6 cores, 15MB Cache, 1866MHz max memory ...
2
votes
1
answer
312
views
MySQL Hardware Bottleneck
I have a web application that makes simple queries to a MySQL database. The database is quite large (8.4GB) and the time to lookup an entry needs to be as fast as possible.
The database represents a ...
2
votes
2
answers
666
views
PostgreSQL on Desktop vs. Server
How does running PostgreSQL on a Windows desktop with pgAdmin III compare to running it on a dedicated server? I am trying to develop a database with very large tables (~60 million rows) with the ...
5
votes
3
answers
3k
views
Single Virtual Drive Vs Multiple Virtual Drives for SQL Server files
Hi guys I have question about how two different Hard disk setups can possibly affect performance of my database.
I have two Options.
Option 1:
One Physical Harddisk and then Multiple Virtual hard ...
3
votes
1
answer
3k
views
SQL Server recommended MAXDOP settings for NUMA
I have an OLTP SQL Database running on SQL 2008 R2 Enterprise Edition that may be fairly busy (5000 batches/sec) in next couple of months after going live production. Looking into server configuration ...
0
votes
1
answer
231
views
intel p3600 SSD no increase in read speed - postgres rdbms vs hdd
We run a custom application that produces analyzable data-sets for medical research.
the amount of data we have is about 600GB in form 3Billion rows distributed in 600+ tables it is hosted in ...
11
votes
1
answer
14k
views
How do you calculate how much hardware resources you need for a database?
We are in the process of scaling our database servers. I was wondering how should we calculate how much hardware resources we need for our databases?
Here is a little bit information about our ...