Questions tagged [memory]

When used in the context of databases, memory refers to RAM directly addressable by the CPU as opposed to going through the I/O subsystem.

Filter by
Sorted by
Tagged with
0 votes
2 answers
58 views

When can we downsize Azure Virtual machine for SQL Server?

For now our production SQL Server is Standard_D96ds_v5 Azure VM machine. We got request to check if we can downsize server to Standard_D48ds_v5. What measures will take into consideration to have ...
adam.g's user avatar
  • 283
2 votes
0 answers
74 views

SQL Server High memory at startup

I have Microsoft SQL server 2019 installed on my Windows Server 2019 server. The memory on the server is 512 GB. When the MSSQLSERVER service starts, MS SQL 2019 immediately consumes 100 GB of memory ...
PetroIvanov's user avatar
0 votes
1 answer
40 views

MySQL NDB Cluster Community - High memory utilization by mysqld only on source/replica nodes

I have two MySQL NDB community clusters 8.0.30, each with 3 VMs Cluster#1_VM1: mysqld + ndb_mgmd Cluster#1_VM2: mysqld + ndb Cluster#1_VM3: mysqld + ndb Cluster#2_VM1: mysqld + ndb_mgmd Cluster#2_VM2: ...
Marcin Stolzmann's user avatar
0 votes
2 answers
35 views

Reducing the number of MySQL processes to save memory

I have just started the MySQL server on my Ubuntu machine, and I see this in htop: There are many mysql processes, each of which takes 4.2% memory. Since I am short on memory, I would like to reduce ...
Erel Segal-Halevi's user avatar
0 votes
1 answer
23 views

MSSQL 2019 CU16 on Linux: virtual_address_space_committed_kb vs RSS

I am running SQL Server 2019 CU15 on Linux in kubernetes and trying to investigate why SQL Server pod gets killed by OOMKiller. I see some inconsistency in reporting of memory consumption. SQL Server ...
Oleg Lavrov's user avatar
0 votes
1 answer
248 views

Error message from server: ERROR: invalid memory alloc request size

I am running with the below issue while taking pg_dump(PG14) of a table with bytea column. pg_dump: error: Error message from server: ERROR: invalid memory alloc request size 1460154641 The command ...
Sajith P Shetty's user avatar
0 votes
0 answers
29 views

Why MongoDB getting higher memory usage?

This is the sample Python code that I used to write data in MongoDB database. After every connection close, I restart the program and I noticed an accumulation in memory count in the Task Manager. ...
Thiwanka Gunasinghe's user avatar
3 votes
3 answers
491 views

MySQL 5.7.42, Gradual memory growth over time, memory leak?

I'm currently running a MySQL server (version 5.7.42) in production, and I've noticed a gradual increase in memory usage throughout the day. I suspect there might be a memory leak issue causing this ...
George's user avatar
  • 31
1 vote
1 answer
307 views

How to release SSAS memory without forcing restart

We have a production server with two SSAS instances, 1 for user querying and 1 with empty templates where we do new releases and (full) processing of the cubes (and then backup and restore processed ...
DBHeyer's user avatar
  • 11
-1 votes
1 answer
151 views

Configure systemd to gracefully restart when memory is almost full

I changed my database to another server, same settings, everything equal, but it seems this new server the memory usage is always close to 100% in less than 2 days (128GB RAM) and I can't upgrade it ...
Freedo's user avatar
  • 188
0 votes
1 answer
204 views

How to Check if SQL Server is Running Out of Memory or CPU Resources RIGHT NOW?

I recently noticed an error message in my SQL Server error log that said "The query processor ran out of internal resources and could not produce a query plan." I suspect that my server ...
Fajela Tajkiya's user avatar
0 votes
1 answer
94 views

Difference between current_allocation s total_allocation in MySQL sys.memory_by_thread_by_current_bytes

I'm trying to debug a memory leak in MySQL 5.7.37 and running the following query gives me insights about the threads running and the memory allocation for each thread. select * from sys....
Sri's user avatar
  • 101
1 vote
1 answer
351 views

PostgreSQL uses huge amount of memory

When executing a query containing WITH and more than a thousand UNION ALL, PostgreSQL version 14 or higher uses all server memory until it enters recovery mode. In tests with version 11, this behavior ...
Rafael Chielle's user avatar
0 votes
1 answer
260 views

MySQL | Measure overall query cost (performance, cpu usage, memory usage)

The Problem You have a MySQL query, let's say a SELECT and you need to identify its overall cost in all aspect (Host Resource Usage, Query speed / performance ...) so that your result can be ...
Federico Baù's user avatar
0 votes
0 answers
326 views

How to minimize risk of ORA-04031 unable to allocate (n) bytes of shared memory across a wide footprint

I monitor thousands of databases that other DBA teams personally manage, and it seems every day there is a one or two databases, usually non-production, throwing "ORA-04031 unable to allocate (n) ...
Paul W's user avatar
  • 359
0 votes
0 answers
29 views

Tabular Cube SSAS Enterprise - Ignoring "LowMemoryLimit"(And All Others)

I have a really big SSAS Tabular cube server, it's has about 1TB of available memory(x1e.8xlarge). I have allot of cubes on it, it's great, I want to add more, I've added a new one and unfortunately I'...
David Rogers's user avatar
0 votes
1 answer
46 views

What is a good test command to cause Postgres to use/fill shared_buffers?

I am doing testing on a replica, trying to diagnose why servers take several minutes to shutdown when fast mode is used. It seems to correlate with high shmem usage, can anyone recommend a good query ...
Gregg Leventhal's user avatar
1 vote
1 answer
411 views

how to prevent out of shared memory error when refreshing materialized views

Postgresql14, Windows server 2012 I get an out of shared memory related to a insufficient max_locks_per_transaction. I have two tables: tbl1 has insert/update every night. These actions trigger a ...
Leehan's user avatar
  • 207
2 votes
0 answers
105 views

MySQL release memory allocated for a temp table

I'm using 5.6 MySQL database to insert tens of millions records between multiple tables. Before the insertion I send all my data into a temp memory table, for that reason I have increased both ...
Maksim Vi.'s user avatar
1 vote
1 answer
394 views

What can I do about "maximum memory usage reached (...), cannot allocate chunk of 1048576" in Cassandra?

I got this error: maximum memory usage reached (536870912), cannot allocate chunk of 1048576. I have increased the file cache to 1024, but I still get the error related to memory usage. What can I ...
Moorghen Lutchmanen's user avatar
0 votes
2 answers
48 views

SQL 2016 Server OS Memory - when the total physical memory is 1.5TB

We are looking into virtualizing a large SQL server. The virtualization would not support 1.5TB and the current server is well overspeced in relation to memory, so we are looking at reducing the ...
Mike Fleming's user avatar
0 votes
0 answers
60 views

MySQL or MongoDB, which is more costly and by how much?

I have a dataset of 5 million customers where READ is the most critical operation (avg READ would be 100K rows every half hour). Each customer record contains typical personal information. What are ...
Eran Betzalel's user avatar
2 votes
1 answer
391 views

MySQL consumes much more memory than configured in innodb_buffer_pool_size

Long story short: I have the buffer pool size = 40G. I have 64GB RAM on my server. But MySQL actually uses 73G of memory (53G physical and the rest swapped). MySQL version: 8.0.22-0ubuntu0.20.04.2 ...
Stalinko's user avatar
  • 181
0 votes
1 answer
98 views

Free memory counter in PerfMon

Just want to make sure I am understanding this correct. Say I have set my maximum server memory according to best practice. Now I see in the the PerfMon counter: SQLServer: Memory Manager - Free ...
xhr489's user avatar
  • 785
-1 votes
1 answer
1k views

Postgres server uses all of RAM and SWAP

The Postgres Server Uses all of 120GB RAM and all SWAP! Is there anything wrong? How can I fix this? This is postgres config shared_buffers = 30GB work_mem = 24MB # It's limited for the ...
rostamiani's user avatar
0 votes
1 answer
172 views

mysqli_fetch_array exceeds memory

I a running a relatively simple query: SELECT gb2_designs.indx, gb2_designs.response_required, gb2_designs.user_design_name, ...
rob boudrie's user avatar
0 votes
1 answer
82 views

How do SQL Server allocate RAM for Job steps?

I am working with SQL Server 2016 and SQL Server 2019 Standard edition. We have this job that's been there for a while. It used to be small but now it runs dozens of SELECT/DELETE statements. (There ...
Danielle Paquette-Harvey's user avatar
0 votes
2 answers
157 views

Better estimating "worst case memory usage" for MySQL

Tools such as MySQLTuner add up globally allocated memory and add it to the product of max connections and per connection memory requirement. I formulated the following query to better estimate how ...
Shahid Thaika's user avatar
2 votes
1 answer
3k views

sql server max memory ideal value best practice

Microsoft SQL Server database is running on the live server and the max memory value is 2147483647 by default. There is no problem in this way, but how far can I lower this value to be more ideal and ...
kadocolak's user avatar
0 votes
1 answer
1k views

I have to restart MySQL to lower the CPU usage

I migrated my server to a new Rocky Linux 9 server and since then, my MySQL server of a web server takes almost 100% of CPU after few hours of use. For now the only way I have found to reduce the CPU ...
London Smith's user avatar
0 votes
2 answers
214 views

Oracle change in PGA resulted in Memory problem

We have Oracle 12c at a Windows Server 2012. PGA memory was: show parameter pga; We changed it to: After 5 days, the Memory increased and eventually the system was down, both the application and the ...
eathan's user avatar
  • 21
9 votes
1 answer
659 views

SQL Server LOB variables and memory usage

When I use a variable of a large object (LOB) data type in SQL Server, is the whole thing kept in memory at all times? Even if it is 2GB in size?
Paul White's user avatar
  • 82.1k
0 votes
1 answer
652 views

How to reduce memory usage in SQL Server when there's a lot of old data

I have some SQL Server instances used to support an app with single tenant DBs, so each instance has roughly 50-80 databases, ranging in data from 500-600GB for all databases combined. This is running ...
Rocket04's user avatar
  • 111
0 votes
1 answer
178 views

SQL Server - Find Memory ALLOCATED vs. Memory ACTUALLY USED

I want to find average Memory USED per day. SQL server caches as much data as possible in RAM (Buffer Cache) - this is ALLOCATED RAM But how much of this data does it actually read subsequently - this ...
d-_-b's user avatar
  • 1,134
7 votes
1 answer
2k views

Memory Requirements for SQL Server

We have a machine with 256 GB RAM. Max server memory for the SQL Server is set to 180 GB. Out of 180 GB, SQL Server typically uses: Database Cache memory - ~ 140-150 GB Plan Cache - ~ 10 GB Stolen ...
Aleksey Vitsko's user avatar
-1 votes
1 answer
231 views

What is the reasoning behind allocating the OS 1GB for each 4GB of RAM? [duplicate]

Link: https://codingsight.com/understanding-the-importance-of-memory-setting-in-sql-server/ Let us now briefly look at the techniques to size the memory. 1 GB of memory reserved for Operating System ...
variable's user avatar
  • 3,360
3 votes
2 answers
285 views

Whether `SQL Server: Memory Manager: Target Server Memory (KB)` is ideal amount of memory based on recent workload OR the max memory setting?

Link: https://learn.microsoft.com/en-us/sql/relational-databases/performance-monitor/monitor-memory-usage?view=sql-server-ver15 SQL Server: Memory Manager: Target Server Memory (KB) This counter ...
variable's user avatar
  • 3,360
0 votes
2 answers
53 views

SQLCONNECTIONPOOL growing very huge

One of my db server SQLCONNECTIONPOOL growing very huge,it consumed 55GB , out of 65Gb (sql MAX) memory) Environment: Microsoft SQL Server 2017 (RTM-CU25) Standard Edition How can i reduce the ...
Kiran Narlapati's user avatar
2 votes
3 answers
5k views

MySQL's maximum memory usage is dangerously high

I'm trying to understand what is not working in my configuration. When I run the [root@server ~]# ./mysqltuner.pl >> MySQLTuner 1.9.8 * Jean-Marie Renouard <jmrenouard@gmail....
Cyril Arnaud's user avatar
0 votes
1 answer
221 views

Free node memory and low PLE

We run a SQL Server 2014 standard edition on a 94 GB RAM server with 82 GB RAM dedicated to SQL. I know PLE is not the answer to all and we should not focus on it too much. But if you look at the ...
KHP's user avatar
  • 65
4 votes
1 answer
3k views

What does the maximum SQL Server memory configuration limit?

Suppose I limit the SQL Server memory to 100 GB. Does this only limit the buffer to 100 GB or does it also limit the query memory grants?
variable's user avatar
  • 3,360
0 votes
3 answers
754 views

How to benchmark the memory requirement fo sql server?

I have a production sql sever with 200GB ram. Of this 150GB is allocated to sql server (by setting max memory settings in sql server properties) The rest is used by ssis, os, anti-virus, apps. I want ...
variable's user avatar
  • 3,360
0 votes
1 answer
265 views

SSMS -- inhibit results or remove temporary files when query is done

I am running several instances of the same query to establish baselines for potential performance optimization. That is, I want to compare timing for two versions of the same query. I am using SSMS ...
JosephDoggie's user avatar
0 votes
0 answers
278 views

SQL Server 2014 consuming more memory than max server memory setting

For the past month, I have noticed our SQL Production server has been consuming more memory than we allocated for it. This is the current structure: Total OS Ram: 31Gb SQL Server currently using ...
sqllover2020's user avatar
0 votes
1 answer
779 views

Does innodb_buffer_pool_size setting affect update queries?

I have a huge database(16GB) to which I wish to add a new column based on an existing column. The existing column looks like this:- MariaDB [demo]> SELECT my_mon FROM mytable; +----------+ | my_mon ...
user2338823's user avatar
1 vote
2 answers
1k views

Memory utilization by SQL Server 2016 [duplicate]

I am running a SQL Server 2016 Enterprise Edition on Windows Server, with 128 GB of memory. During installation, I assigned 124 GB to the SQL server, since the server is dedicated to SQL only, leaving ...
Nidhi 's user avatar
  • 11
0 votes
0 answers
135 views

MS SQL: Out of memory happened while accessing a critical resource

How do I go about resolving "Out of memory happened while accessing a critical resource" errors? I have sufficient RAM (1.82TB) on a VMWare Win 2016 Std; MS SQL 2019 CU12 Ent 32 cores with ...
NeilR's user avatar
  • 1
11 votes
2 answers
3k views

SQL Server is using a lot more RAM than it should

I have a SQL Server 2012 instance using more RAM that it should. The SQL Server process is using about 22.5GB RAM: The instance is configured to use a maximum of 10GB: Which is way more then ...
Dominique Boucher's user avatar
1 vote
1 answer
241 views

Does the query still run even when SQL Server can't grant the requested memory for the query?

I was thinking about something like this today but I couldn't find this piece of information. When the SQL Server requests memory and the OS can't provide it, we get a RESOURCE_SEMAPHORE wait type. ...
Racer SQL's user avatar
  • 7,344
4 votes
2 answers
7k views

SQL Server 2017; Memory troubleshooting; There is insufficient system memory in resource pool 'internal' to run this query

We are running a local SQL Server 2017 to support a datawarehouse database. The database is loaded on a schedule through SSIS largely through the use of staging tables and the MERGE function. Recently,...
Antyan's user avatar
  • 158

1
2 3 4 5
15