Questions tagged [storage-engine]
The storage-engine tag has no usage guidance.
92
questions
1
vote
2
answers
131
views
Efficient way to store and retrieve big amount of data
I need to store a big amount of data (about 2.5 billion of new data rows per month), but also I need a very fast way to retrieve the latest value per group on specific time point. The data looking ...
- 11
0
votes
1
answer
331
views
Best way to store HTML dropdown options
I'm developing a web site for a model agency. I have a "model" table with the details about each model (this is just an example):
CREATE TABLE model {
model_id INT PRIMARY KEY,
name VARCHAR(...
CommunityBot
- 1
0
votes
1
answer
316
views
Change Storage Engine on Referenced Tables
i need to change storage engine from 'InnoDB' to 'MyISAM' on some tables of different databases.
So i made a script file to do so:
#!/bin/bash
DATABASES=$(mysql -u XXXXX -pXXXXX --skip-column-names -...
CommunityBot
- 1
0
votes
1
answer
37
views
what is the difference between data warehouse engine, data warehouse, olap engine, olap database, data storage engine vs data storage?
I need to clarify the keyword "engine" and what functionality stands behind it. I assume engine is a smaller component of a bigger thing - database. Like a 'car engine' is inside a car.
So ...
- 607
3
votes
1
answer
1k
views
Kafka Internal Data structure vs LSM tree
I was going through Database storage engines and found out about LSM trees. I had also read about Kafka architecture and know that Kafka internally is a commit log. I want to know if Kafka internally ...
- 26.6k
5
votes
1
answer
828
views
What page type is page 516855552?
SQL Server tracks page allocation in various internal bitmaps. Among these are the Global Allocation Map (GAM) and Page Free Space (PFS) pages. We know that GAM pages occur at set intervals of 511232 ...
- 28.3k
7
votes
3
answers
769
views
What is the stride of a GAM interval
For interest, I was reading about the internal structures of a Microsoft SQL Server file. It's fairly obvious how IAM pages are connected. However, it is not clear to me where later GAM pages are to ...
CommunityBot
- 1
0
votes
1
answer
2k
views
MariaDB not starting in windows 10 after crash
MariaDB 10.7 service suddenly stopped in Windows 10 after a crash and the service is not starting. The pop up shows 'windows cannot start mariadb service). The windows event viewer gives the following ...
- 121
3
votes
1
answer
315
views
WiredTiger Page Size
I'm unable to find out if there is a pagesize in a WiredTiger MongoDB storage engine.
I mean some analog of the innodb_page_size for MySQL.
- 183
0
votes
0
answers
872
views
Table-specific storage engines blocking mysql_secure_installation
I've just installed MySQL 8.0 on an Ubuntu 22.04 system. I tried running mysql_secure_installation, but I got the following error:
New password:
Re-enter new password:
... Failed! Error: ...
- 111
1
vote
1
answer
102
views
How to change the engline type from InnoDb to MyISAM of an existing db?
I have a MariaDb database which consists of 2 tables and which is around 10Gb of the size. One is dependendant on the other via a foreign key.
How can I change the engine type of that particular db ...
- 184k
7
votes
5
answers
29k
views
How to Add Federated engine after installing Mysql
I have Mysql 5.5.18
and upon show engines:
show engines;
+--------------------+---------+------------------------------------------------------------+--------------+------+------------+
| Engine ...
0
votes
1
answer
97
views
Primary File Organization in DBMS - Files of ordered records (sorted files)
"Fundamental of Database Systems", 3rd ed. by Elmasri and Navathe, page 136 says:
"We can physically order the records of a file on disk based on the values of one of their fields [...]&...
- 33
0
votes
2
answers
477
views
Disabling Aria INSERT log in MariaDB [closed]
When I bulk INSERT into an Aria table, it creates a copy of the INSERT in a series of log files (aria_log.%). It can lead to full disk and crash of MySQL.
As I understand, Aria keeps a redo log for ...
- 4,541
15
votes
1
answer
2k
views
Do databases make a delete and an insert when having to update rows?
So today a professor told us that when the database has to make an update, internally (at low level) it makes a delete and then an insert with the updated fields. He then said that this is something ...
- 88.2k
1
vote
2
answers
1k
views
Is there a query to set a table's engine to innodb if it's not already?
I can set a (MyISAM) table's engine to InnoDB using the query:
alter table tablename engine=InnoDB
which takes some time to complete for large tables. It appears though that if I run the same query ...
1
vote
1
answer
248
views
How to add sphinx engine to mysql 5.7?
On my Ubuntu 18.04 machine using mysql 5.7 I have installed sphinxsearch 2.2 and now I'd like to add SphinxSE as an engine so that I can connect to it without language-specific medium.
The docs on ...
- 7,929
8
votes
1
answer
11k
views
Do you still use MyISAM or prefer Aria storage engine?
If Aria storage engine (previously called Maria) is the "new" MyISAM, which supports transaction and automatic crash recovery:
Why still use MyISAM ?
Should changing storage engine from MyISAM to ...
- 184k
-1
votes
1
answer
157
views
MariaDB CONNECT engine to read external mongodb collections
I want to access MongoDB collections through MariaDB 10.4.17. Both are installed on my local machine running Windows 10.
Software
listening port
MongoDB
27017
MariaDB
15501
I installed the MariaDB ...
- 69
6
votes
1
answer
4k
views
Which mysql storage engine to choose?
I'm confused about which mysql engine should I choose (lets talk about the most used : MyISAM and InnoDB).
The theories say:
Both work with BTree indexes, but MyISAM can work with FULLTEXT index ...
- 184k
1
vote
0
answers
51
views
Non RAM based in-browser database solutions?
I want to decentralize my databases and upload it to Sia Skynet to give the users the ability to search on front-end. It is important to be able to deal with large amounts of data, but the RAM-based ...
- 119
0
votes
2
answers
108
views
What MariaDB storage engine should i use?
I have a database with size about 170GB with rows between 20.000 - 700.000.000 rows (depending on the table). Currently i'm using MyISAM storage engine.
In my case, querying (READ) speed is very ...
- 78.9k
1
vote
0
answers
24
views
Is there any such thing as an https storage engine?
Maybe I have too much time on my hands, and this may be a stupid idea, but...
I have recently had to download data in table-form from websites, and I got to thinking that it might have been easier, ...
- 231
2
votes
1
answer
511
views
Disable database tables for writes but report writes as successful
I manage a database where thousands of GBs of useless log data is created daily.
I can't fix the software that is performing all of this (unnecessary) logging. Is there a way to lock (or disable ...
- 30.3k
38
votes
7
answers
54k
views
What are reasons **NOT** to use the MEMORY storage engine in MySQL?
I recently discovered that MySQL has a "memory" engine that I wasn't aware of (most of my database work is for hobby projects so I learn what I need as I go). It seems like this option should give me ...
- 30.3k
3
votes
2
answers
2k
views
MySQL lock on MEMORY storage engine, when does it apply?
I want to use MySQL MEMORY storage engine to handle my PHP session variables (actually I already implemented it but since all my tests are being done by a single user, me, I am unable to notice this).
...
CommunityBot
- 1
0
votes
2
answers
2k
views
Inserting into mysql table with archive engine "duplicate key" error
I am trying to archive some files using mysql archive engine. I am using this query to insert file contents:
insert into test_table (id,arch) values (123,'FILE_CONTENT')
After inserting 2 records, I ...
- 207
3
votes
0
answers
174
views
Moving from dynamic disk allocation to direct space disk via storage pool in SQL server
Pardon me if I am not clear in asking the question since I have very less understanding from storage terms used or how it's used with Sql server.
Currently our storage team is testing to move disk ...
- 7,177
3
votes
3
answers
12k
views
Migrate Jira to MySql - Unknown system variable 'storage_engine'
I'm migrating JIRA in Windows from HSQL to MySQL and I got stuck with the message Unknown system variable 'storage_engine'. Though I created a backup, installed MySQL and copied J connector to libs ...
- 184k
0
votes
1
answer
63
views
csv engine and mysql start
my question is about speed when perform service mysql start.
with many tables (some not often used).
what engines consumes more or less start time ?
example: innodb --> the more tables, the more ...
- 78.9k
0
votes
1
answer
80
views
Does any MariaDB engine have the option to declaratively or configuratively abstract highly-redundant data?
I have an application which is architected in a "NoSQL" style around one fully denormalized "main table" which currently just holds a primary key and one JSON-valued column. For reasons which are ...
- 78.9k
12
votes
2
answers
5k
views
Does AWS RDS support MEMORY storage engine?
Title says it all. Strangely can't find a result on this.
- 223
2
votes
1
answer
1k
views
SQL SERVER Database IO performance impact of splitting database tables into FileGroups and multiple Files per filegroup
SAN LUN ambiguity wrt performance
MSDN says to split read/write operations into a drive, sequential writes to another drive. (PRIMARY filegroup use typically data with read, update, write activity ...
CommunityBot
- 1
0
votes
1
answer
684
views
(Mysql) Using Memory engine for 4.3 million row table?
My new company stores an intermediate data for our loading process in a table using the memory engine. However a quite simple update (set a.id=b.id) is taking something like six hours to run.
I've ...
- 78.9k
5
votes
2
answers
20k
views
MongoDB - Unable to change mongodb storage engine to WiredTiger
I have installed MongoDB in Ubuntu 14.04 but I am unable to change its storage engine to WiredTiger.
I have added the necessary changes to the /etc/mongod.conf file which is namely as the following-:
...
- 26.6k
3
votes
1
answer
2k
views
MySQL query 'going away' on executing INSERT ON DUPLICATE UPDATE statement with a 12524 character blob
I have a mysql insert on update query like so
insert into table (col1, col2, col3) values (1,2,'huge blob with 12524 chars') on duplicate key update col3 = 'huge blob with 12524 chars';
col1, col2 ...
- 101
0
votes
2
answers
665
views
Unable to Convert table Engine from MyISAM to NDBCLUSTER
I followed @RolandoMySQLDBA 's tips in this thread: mysql, changing tables from myisam to ndb But I didn't succeed on the last step.
I have a similar problem, here's my original table:
CREATE TABLE ...
- 78.9k
3
votes
1
answer
4k
views
How to export mysql databases with different ENGINE?
I'm setting up MySQL Cluster. As it uses ENGINE=NDBCLUSTER, how could I export my databases from MySQL Server specifying the ENGINE?
Is there a way to do this?
All my tables are MYISAM
- 184k
1
vote
1
answer
698
views
What storage engine should I use for this MySQL table?
I have a table where I store all the urls from my website, and I update them from time to time when a visitor enters.
The primary key is the url itself varchar(255).
I have set it to use InnoDB but ...
- 184k
2
votes
1
answer
84
views
Alternative ways to find tables with specific storage engine?
I have a VPS with three accounts and 5 db's. Recently I added MySQLTuner. All of my tables are MyISAM, but the results MySQLTuner are showing that I have 14 tables that use InnoDB.
[--] Data in ...
- 184k
9
votes
1
answer
640
views
Understanding IAM Pages: extent intervals
I'm reading Itzik's book "Querying Microsoft SQL Server 2012" as well as reading/watching different educational material on the internet. My intention is to have a useful understanding of how the ...
- 193
1
vote
0
answers
277
views
Is the idea of 'pages' and 'extents' unique to SQL Server or shared by other database management systems?
I know that a database management system like MySQL can make use of multiple storage engines - i.e. InnoDB, MyISAM, etc.
And reading into how SQL Server stores data (Understanding Pages and Extents), ...
- 8,540
0
votes
1
answer
2k
views
mongodb inMemory engine available in the community edition?
I'm currently working with MongoDB 3.2.10 and I recently heard of the new "inMemory" engine. After some research I found that it was available in the Enterprise Edition since version 3.2.6, but I ...
CommunityBot
- 1
1
vote
1
answer
214
views
DBCC PAGE read page from buffer pool or directly from the file system?
We know that SQL Server always read pages from disk to memory for all its operations. So it's possible that a page in memory is different from it's counterpart in disk. I want to know the command DBCC ...
- 34.8k
26
votes
3
answers
24k
views
MongoDB MMAPv1 vs WiredTiger storage engines
In mongoDB3 appeared a new storage engine: WiredTiger. Yet, MMAPv1 is still the default choice in Mongo.
One might not be better than the other, it's often a matter of use case and choosing the ...
- 41
1
vote
1
answer
597
views
Fastest engine for Mass Updates (only updates done on table)
I have a table of 2 columns and 60 million rows. I want to update the table by incrementing one field by 1 on various different rows (This is the only type of operation that will ever be done on the ...
CommunityBot
- 1
2
votes
1
answer
491
views
Sync two MySQL servers data, while changing the Engine in the slave
I'm running a MySQL server 5.5.44, and I'd need to sync its data to a new server running MySQL 5.7.13 using master-slave. The idea is to bring both DBs synced until we migrate to the second, newer ...
CommunityBot
- 1
1
vote
1
answer
754
views
MongoDB Storage Engine
How can I change the storage engine of MongoDB permanently so that I don't have to run mongod without having to specify the storage engine every time? I am using shell version 3.2.7 on Windows 7 32-...
- 23.1k
1
vote
1
answer
2k
views
howto read/interpret "show engine innodb mutex" output?
We use a 3 node Galera cluster with version 5.5.41-MariaDB-wsrep
MariaDB [(none)]> show engine innodb mutex;
+--------+---------------------------------+------------------+
| Type | Name ...
- 78.9k
0
votes
1
answer
276
views
Mysql read only engine type and indexes
I have a mysql table. This table has only three columns. Two are varchar (5),and one is varchar (32).
There will only be one query run against table.
Select (column 1),(column 2) from mytable where ...
- 5,130