Questions tagged [fragmentation]
Fragmentation exists when indexes have pages in which the logical ordering, based on the key value, does not match the physical ordering inside the data file.
152
questions
0
votes
1
answer
59
views
mysql reuse of deleted rows
Using MySql and innodb with innodb_file_per_table flag ON.
We have a table with a size of ~100GB.
We delete the data and insert fresh data (approx same size) every day (the delete is in chunks by a ...
0
votes
1
answer
83
views
Fragmentation when creating non-clustered index
When I was dealing with fragmentation, I had a question about a non-clustered index. In non-clustered index actual table data (typically stored in a clustered index, otherwise a heap) is stored ...
0
votes
1
answer
2k
views
Reclaiming Disk Space for MariaDB Table
I'm facing a disk space issue with a MariaDB database and would appreciate your insights on resolving it.
Here's the scenario:
MariaDB version: 10.3
OS: Ubuntu 20.04
Engine: Innodb
Table name: '...
0
votes
1
answer
212
views
How can I monitor and address fragmentation on RDS for Oracle database?
I'm planning to migrate my database from on-premises to AWS RDS for Oracle. However, I'm not sure if Amazon RDS supports tools such as Automatic Fragment Advisor or the Automatic Segment Space ...
1
vote
2
answers
73
views
Does clustered index fragmentation happen in relational DBMS?
Is it possible that after a certain pattern of random inserts and deletes leaf data nodes become fragmented with clustered index?
I.e, that the physical order does not reflect the logical order (by ...
2
votes
2
answers
2k
views
How defragment compressed partitioned table in oracle?
I have partitioned table by day with compressed query high option for partitions in Oracle 11.2 database.
Delete by key and direct insert was used to populate a data for the table. So the table is ...
- 33
3
votes
1
answer
184
views
Is concept of fill factor useful only when index is rebuilt?
Fill factor is concept that works only when creating a new index or when the index is rebuilt.
Subsequently there will be fragmentation due to inserts/updates which will create new pages (page split) ...
- 3,456
0
votes
3
answers
689
views
Will I need to fix fragmentation after shrinking a database full of only HEAPs?
I have a 1 TB database that contains hundreds of quarterly archive tables and I am looking to drop any table older than 5 financial quarters, which will free up ~600gb of space. To provide an example ...
- 255
0
votes
2
answers
193
views
I think SQL Docs are wrong for sys.dm_db_index_physical_stats
Go to this documentation page:
https://learn.microsoft.com/en-us/sql/relational-databases/system-dynamic-management-views/sys-dm-db-index-physical-stats-transact-sql?view=sql-server-ver15
Then go to ...
- 363
1
vote
1
answer
383
views
How does page split result in index fragmentation?
I am trying to understand the reason behind index fragmentation.
Assuming fill factor is 100% and the clustered index is on an integer column. The values on each page are as follows and assuming that ...
- 3,456
0
votes
0
answers
42
views
Running Index defragmentation with SQL Job (looks like every night!)
After running sp_blitzcache (over time) I have found that everyday my plan cache is compiling new execution plans. 100% of my plan cache is built within the last 24 hours (each day).
I think these ...
- 1
2
votes
1
answer
395
views
Does a fragmented database cause the transaction log to grow faster?
Hoping to get some clarity here as I've reached the limits of my SQL knowledge. The company I work for sells products storing data in Microsoft SQL Server databases, but our focus isn't really on the ...
- 21
1
vote
1
answer
162
views
Index maintenance for AG DBs
I wanted to get some opinions on the index maintenance we currently do at the company where I work. One of our production SQL 2012 clusters that consists of 4 nodes, with two instances on each, has ...
- 53
0
votes
1
answer
29
views
Is twitter's character limit a way they found to avoid drastic database fragmentation? [closed]
so I just started reading a book about "Mongo schema design" and am currently reading the portion about MMAP and fragmentation.
From what I understood there are different ways to avoid ...
- 125
-1
votes
1
answer
7k
views
How do we select fragmented indexes from postgresql?
Need to select indexes which are fragmented for a certain level. Can someone help me with the query for that?
-1
votes
1
answer
663
views
How to practically run sys.dm_db_index_physical_stats against 460 THOUSAND tables?
I've been tasked with maintaining an old (SQL 2005; no, I can't upgrade it!) server which has 461,000 tables and 1.15M indexes. How do I go about analyzing all those indexes in bite-sized chunks?
My ...
- 646
0
votes
1
answer
100
views
Index Fragmentation - log issues
I have a few questions that I want to understand in order to take informed decision. I am not a DBA by profession, I have done some administrative tasks in the past and now I would have to create a ...
- 23
1
vote
1
answer
289
views
Is fragmentation at non-leaf levels a problem?
SQL version: 2017 Standard x64
OS: Windows Server 2016 Datacenter (10.0)
I've just created some minimal indexes on ETL tables which were previously heaps with no indexes. Both R and W performance ...
- 125
5
votes
1
answer
2k
views
SQL Server - Very high disk activity after running query?
I'm running SQL Server Express 12.0.4100 on an AWS instance with 16 cores and 64 GB of RAM with a 3TB and 9000 IOPS EBS attached. This has been running for 2 years perfectly with no issues until this ...
- 183
2
votes
1
answer
418
views
How big of a table or how many data pages in an index is worth considering running index rebuild or index reorganize operations on?
In the Books Online for Reorganize and Rebuild Indexes Microsoft mentions:
Rebuilding or reorganizing small rowstore indexes often does not reduce fragmentation.
What magnitude of number of rows ...
- 38.7k
3
votes
1
answer
815
views
Do I need to rebuild heap table after rebuilding a non-clustered index?
Assume that I have a heap table with a higher fragmentation percentage and that table also has a non-clustered index with higher fragmentation too. I can't reproduce this case right now but maybe ...
- 1,303
0
votes
1
answer
520
views
IndexOptimize is successful, but sys.dm_db_index_physical_stats still shows huge fragmentation
I'm working on a project that requires a database shrink. Following the shrink, I checked sys.dm_db_index_physical_stats and can see a lot of my indexes are over 99% fragmented (...
- 163
0
votes
1
answer
729
views
MongoDB Fragmentation affect the Performance in WiredTiger
Im using MongoDB 3.6 I have a huge number of fragmentation in my collections. 300+ GB on one collection. WiredTiger is the storage engine.
I know its bad for the OS and much wasted space. This ...
- 1,960
0
votes
0
answers
144
views
Problem with calculating an approximate space required for online index rebuild
I have a database called TestDB which is in simple recovery model. I performed index rebuild on my Test Server which has no other user transactions except me. Before an online index rebuild the sizes ...
- 1,303
4
votes
4
answers
328
views
Is fragmention limited to indexes in sql server?
As far as I can see with research the only thing that fragments is indexes no other objects in SQL can fragment.
I have to keep track of fragmentation within multiple databases, would it be correct ...
5
votes
3
answers
597
views
How likely is fragmentation on a table with 40000 products likely to affect performance
So database administration is not a strong point of mine, so I have a few questions.
This all relates to the performance of a website I'm looking at, and have spent a fair bit of time researching/...
- 165
0
votes
1
answer
217
views
Not lowering avg fragmentation
I have a script which iterates through all database and underlying tables. With this script i want to rebuild/reorganize the indexes and i am testing this on AdventureWorks2017 database. So after ...
- 1
8
votes
1
answer
1k
views
Index fragmentation problem after disabling page-level locking for an Index
I have an Index which has page level locking disabled and now I have index fragmentation issues for that index.
I was aware that I won't be able to Reorganize the index, but I believed that I would ...
- 1,335
5
votes
2
answers
3k
views
Indexes getting highly fragmented during normal usage of system
I am using MS SQL Server 2014 Standard Edition in my project and recently I have encountered an issue with index fragmentation getting high during normal usage of the system by the users.
Currently ...
- 51
4
votes
1
answer
277
views
Huge Heap Table and table compression on SQL Server 2016
My database size is huge, and recently I noticed that a new table added few months ago is the culprit.
Here is the table script.
SET ANSI_NULLS ON
GO
SET QUOTED_IDENTIFIER ON
GO
CREATE TABLE [dbo]....
- 1,335
1
vote
1
answer
674
views
Is this database fragmentation or something else? What can be done?
I have the table below in PostgreSQL (automagically generated with insertions using Marten):
create table mt_doc_order
(
id uuid ...
- 113
3
votes
3
answers
14k
views
Query to see Index Fragmentation on all databases without using SP or temp tables
I am trying to compile a index fragmentation report on all databases, in a multi-server environment. The query will be executed via an openquery command, so I would like to make it as simple as ...
- 303
1
vote
1
answer
289
views
Is there any way to find information of index fragmentation, Statistics information with the help of system tables in SQL Server
I am working on a report which will give information for different segments like
blocking process
slow running queries
disk space etc.
I also want to add one more segment where I can get ...
3
votes
1
answer
11k
views
Table Fragmentation
If I execute the following:
SELECT dbschemas.[name] as 'Schema',
dbtables.[name] as 'Table',
dbindexes.[name] as 'Index',
indexstats.alloc_unit_type_desc,
indexstats.avg_fragmentation_in_percent as ...
- 123
4
votes
1
answer
1k
views
Fragmentation Level for Heaps
I am currently using scripts provided by Mr. Ola Hallengren for executing maintenance job and of-late I have been noticing that there are many tables (heaps) fragmentation level is alarmingly high and ...
- 3,904
0
votes
2
answers
783
views
Will frequent creation and deletion of TABLE (not indexes) cause fragmentation in database?
Does frequent creation and deletion of physical table in database causes fragmentation? I am frequently creating and deleting database for loading data warehouse load. I am using these table to hold ...
0
votes
1
answer
2k
views
MariaDB defragmenting with new option innodb-defragment=1
I try to defragment table using innodb-defragment=1
https://mariadb.com/kb/en/library/defragmenting-innodb-tablespaces/
But it was a bad experience :
- locks on table
- no a good defragmentation ...
- 103
0
votes
1
answer
422
views
use DBCC SHRINKDATABASE after rebuild / reindex [duplicate]
I have little free disk space.
Why shouldn't you use DBCC SHRINKDATABASE (DBName, TRUNCATEONLY) after every rebuild/reindex operation?
3
votes
2
answers
475
views
SQL Server one-to-many and index fragmentation
I'm currently writing code to update an entities child collection (one-to-many relationship), and while thinking about how to write code to determine which entities have been added/removed/modified, I ...
- 83
3
votes
3
answers
32k
views
Table and Index fragmentation
Is there any way to check whether a table or index has been fragmented?
How to check if table is fragmented or not?
How to check if index is fragmented?
I searched Google but didn't get ...
Onkar Tiwari
0
votes
1
answer
1k
views
Index Maintenance - Reorganize After BIG SQL Server Shrink
I'm planning to execute the below index maintenance created by Ola Hallengren in a 1TB Database.
EXECUTE [dbo].[IndexOptimize]
@Databases = 'USER_DATABASES',
@FragmentationLow = NULL,
@...
user141153
1
vote
0
answers
63
views
Fragmentation of indexes with small a database
I'm trying to figure out whether its worth defragging a 2GB mssql database.
indexs are above 70% fragmented but queries don't appear to be talking too along.
That being said I am having a delay when ...
- 63
3
votes
2
answers
1k
views
How to Limit DTU Percentage Consumption for a Given Session in Azure SQL Database?
We have an Azure SQL Database tier S4 (200 DTU), and there is one big table inside
When I run a "alter index rebuild..." statement, it takes about 18 mins to complete
This particular nonclustered ...
- 5,884
0
votes
2
answers
141
views
Is Ola Hallengrens Stored Procedure what we need and safe to use [closed]
I stumbled across a stored procedure and wanted to clarify a few things first as I’ve been told it needs “rigorous review before being executed on any server”, and “testing before we run it on a ...
- 219
4
votes
1
answer
4k
views
Is high index fragmentation an issue on performance
Below is a small sample (top 20ish) from over 8000 indexes in avg_fragmentation_in_percent descending order. Will this cause any performance issues?
- 219
-1
votes
1
answer
581
views
Fragmentation in InnoDB tables: dump all data together reduced size, but fragmentation got worse [closed]
I have a question about tables and fragmentation in MySQL
My starting point is this question:
How find and fix fragmented MySQL tables
I have a table with 1 million of rows and 128MB of space. This ...
- 141
1
vote
3
answers
374
views
DataBase Performance Issues with Indexes
I'm reviewing a production database with over 400 tables and 658 indexes. I have determined that only 440 of these indexes are being used. Of these, many have fragmentation approaching 100% so I will ...
- 115
0
votes
2
answers
464
views
Should I defragment InnoDB table with fixed-length fields?
I am running MariaDB 10.2.13 on Linux (Debian).
I am setting up an InnoDB table that will record a lot of data but I will keep only the last one-hour rows. Thus, the number of rows will remain ...
- 2,418
1
vote
1
answer
1k
views
test data to generate high index fragmentation level
I want to test the rebuild and reorganize operations for the indexes in sql server and for that I need to populate the db with test data that generates high fragmentation levels/percentages. Does ...
- 133
2
votes
1
answer
432
views
defragment SQL server database
I have deleted some tables on a SQL server. Suddenly the size of the database jumped by 100Gb (whereas the deleted tables were taking 10% of that..).
I have read good and bad things about SHRINK ...
- 398