Questions tagged [storage-engine]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
33 views

Primary File Organization in DBMS - Files of ordered records (sorted files)

"Fundamental of Database Systems", 3rd ed. by Elmasri and Navathe, page 136 says: "We can physically order the records of a file on disk based on the values of one of their fields [...]&...
user avatar
  • 33
0 votes
2 answers
63 views

Disabling Aria INSERT log in MariaDB [closed]

When I bulk INSERT into an Aria table, it creates a copy of the INSERT in a series of log files (aria_log.%). It can lead to full disk and crash of MySQL. As I understand, Aria keeps a redo log for ...
user avatar
  • 4,179
1 vote
1 answer
90 views

How to add sphinx engine to mysql 5.7?

On my Ubuntu 18.04 machine using mysql 5.7 I have installed sphinxsearch 2.2 and now I'd like to add SphinxSE as an engine so that I can connect to it without language-specific medium. The docs on ...
user avatar
  • 145
0 votes
1 answer
397 views

Kafka Internal Data structure vs LSM tree

I was going through Database storage engines and found out about LSM trees. I had also read about Kafka architecture and know that Kafka internally is a commit log. I want to know if Kafka internally ...
user avatar
-1 votes
1 answer
59 views

MariaDB CONNECT engine to read external mongodb collections

I want to access MongoDB collections through MariaDB 10.4.17. Both are installed on my local machine running Windows 10. Software listening port MongoDB 27017 MariaDB 15501 I installed the MariaDB ...
user avatar
  • 69
0 votes
0 answers
48 views

Non RAM based in-browser database solutions?

I want to decentralize my databases and upload it to Sia Skynet to give the users the ability to search on front-end. It is important to be able to deal with large amounts of data, but the RAM-based ...
user avatar
  • 109
0 votes
2 answers
75 views

What MariaDB storage engine should i use?

I have a database with size about 170GB with rows between 20.000 - 700.000.000 rows (depending on the table). Currently i'm using MyISAM storage engine. In my case, querying (READ) speed is very ...
user avatar
1 vote
0 answers
22 views

Is there any such thing as an https storage engine?

Maybe I have too much time on my hands, and this may be a stupid idea, but... I have recently had to download data in table-form from websites, and I got to thinking that it might have been easier, ...
user avatar
  • 221
2 votes
1 answer
125 views

Disable database tables for writes but report writes as successful

I manage a database where thousands of GBs of useless log data is created daily. I can't fix the software that is performing all of this (unnecessary) logging. Is there a way to lock (or disable ...
user avatar
  • 188
3 votes
0 answers
93 views

Moving from dynamic disk allocation to direct space disk via storage pool in SQL server

Pardon me if I am not clear in asking the question since I have very less understanding from storage terms used or how it's used with Sql server. Currently our storage team is testing to move disk ...
user avatar
  • 2,137
0 votes
1 answer
50 views

csv engine and mysql start

my question is about speed when perform service mysql start. with many tables (some not often used). what engines consumes more or less start time ? example: innodb --> the more tables, the more ...
user avatar
  • 113
0 votes
1 answer
38 views

Does any MariaDB engine have the option to declaratively or configuratively abstract highly-redundant data?

I have an application which is architected in a "NoSQL" style around one fully denormalized "main table" which currently just holds a primary key and one JSON-valued column. For reasons which are ...
user avatar
  • 196
2 votes
1 answer
1k views

SQL SERVER Database IO performance impact of splitting database tables into FileGroups and multiple Files per filegroup

SAN LUN ambiguity wrt performance MSDN says to split read/write operations into a drive, sequential writes to another drive. (PRIMARY filegroup use typically data with read, update, write activity ...
user avatar
  • 333
0 votes
1 answer
632 views

(Mysql) Using Memory engine for 4.3 million row table?

My new company stores an intermediate data for our loading process in a table using the memory engine. However a quite simple update (set a.id=b.id) is taking something like six hours to run. I've ...
user avatar
  • 143
0 votes
2 answers
537 views

Unable to Convert table Engine from MyISAM to NDBCLUSTER

I followed @RolandoMySQLDBA 's tips in this thread: mysql, changing tables from myisam to ndb But I didn't succeed on the last step. I have a similar problem, here's my original table: CREATE TABLE ...
user avatar
  • 103
9 votes
1 answer
542 views

Understanding IAM Pages: extent intervals

I'm reading Itzik's book "Querying Microsoft SQL Server 2012" as well as reading/watching different educational material on the internet. My intention is to have a useful understanding of how the ...
user avatar
  • 193
1 vote
0 answers
234 views

Is the idea of 'pages' and 'extents' unique to SQL Server or shared by other database management systems?

I know that a database management system like MySQL can make use of multiple storage engines - i.e. InnoDB, MyISAM, etc. And reading into how SQL Server stores data (Understanding Pages and Extents), ...
user avatar
  • 2,222
12 votes
2 answers
4k views

Does AWS RDS support MEMORY storage engine?

Title says it all. Strangely can't find a result on this.
user avatar
  • 223
5 votes
2 answers
16k views

MongoDB - Unable to change mongodb storage engine to WiredTiger

I have installed MongoDB in Ubuntu 14.04 but I am unable to change its storage engine to WiredTiger. I have added the necessary changes to the /etc/mongod.conf file which is namely as the following-: ...
user avatar
  • 153
1 vote
1 answer
173 views

DBCC PAGE read page from buffer pool or directly from the file system?

We know that SQL Server always read pages from disk to memory for all its operations. So it's possible that a page in memory is different from it's counterpart in disk. I want to know the command DBCC ...
user avatar
0 votes
1 answer
2k views

mongodb inMemory engine available in the community edition?

I'm currently working with MongoDB 3.2.10 and I recently heard of the new "inMemory" engine. After some research I found that it was available in the Enterprise Edition since version 3.2.6, but I ...
user avatar
  • 103
0 votes
1 answer
214 views

Best way to store HTML dropdown options

I'm developing a web site for a model agency. I have a "model" table with the details about each model (this is just an example): CREATE TABLE model { model_id INT PRIMARY KEY, name VARCHAR(...
user avatar
  • 9
2 votes
1 answer
404 views

Sync two MySQL servers data, while changing the Engine in the slave

I'm running a MySQL server 5.5.44, and I'd need to sync its data to a new server running MySQL 5.7.13 using master-slave. The idea is to bring both DBs synced until we migrate to the second, newer ...
user avatar
1 vote
1 answer
710 views

MongoDB Storage Engine

How can I change the storage engine of MongoDB permanently so that I don't have to run mongod without having to specify the storage engine every time? I am using shell version 3.2.7 on Windows 7 32-...
user avatar
0 votes
1 answer
223 views

Mysql read only engine type and indexes

I have a mysql table. This table has only three columns. Two are varchar (5),and one is varchar (32). There will only be one query run against table. Select (column 1),(column 2) from mytable where ...
user avatar
1 vote
1 answer
1k views

howto read/interpret "show engine innodb mutex" output?

We use a 3 node Galera cluster with version 5.5.41-MariaDB-wsrep MariaDB [(none)]> show engine innodb mutex; +--------+---------------------------------+------------------+ | Type | Name ...
user avatar
  • 2,188
15 votes
1 answer
2k views

Do databases make a delete and an insert when having to update rows?

So today a professor told us that when the database has to make an update, internally (at low level) it makes a delete and then an insert with the updated fields. He then said that this is something ...
user avatar
3 votes
2 answers
1k views

MySQL lock on MEMORY storage engine, when does it apply?

I want to use MySQL MEMORY storage engine to handle my PHP session variables (actually I already implemented it but since all my tests are being done by a single user, me, I am unable to notice this). ...
user avatar
1 vote
1 answer
220 views

Does TokuDB need any regular cleanup/maintenance?

PostgreSQL has vacuum and InnoDB has purge. Does TokuDB have any required maintenance/cleanup operations? I couldn't find anything in the online docs: https://www.percona.com/software/mysql-database/...
user avatar
  • 329
2 votes
1 answer
82 views

Alternative ways to find tables with specific storage engine?

I have a VPS with three accounts and 5 db's. Recently I added MySQLTuner. All of my tables are MyISAM, but the results MySQLTuner are showing that I have 14 tables that use InnoDB. [--] Data in ...
user avatar
  • 43
26 votes
3 answers
24k views

MongoDB MMAPv1 vs WiredTiger storage engines

In mongoDB3 appeared a new storage engine: WiredTiger. Yet, MMAPv1 is still the default choice in Mongo. One might not be better than the other, it's often a matter of use case and choosing the ...
user avatar
  • 365
0 votes
2 answers
78 views

What storage engine do I need - Mysql?

I have designed a database and came to the point of actually deciding which storage engine is better for my case. I estimate that during the first few years I would have around 100,000 - 500,000 ...
user avatar
  • 203
2 votes
1 answer
655 views

SQLyog and MariaDB engine

I am quite new in MariaDB and I use SQLyog Community Edition as the frontend GUI. Whenever I create a new table, on the Engine dropdown, there is no XtraDB option. Is there any additional steps I am ...
user avatar
4 votes
1 answer
749 views

MariaDB Spider Engine Out of Memory

I had almost standard MariaDB with InnoDB engine working fine but I wanted to test out the Spider Engine + Sharding/Partitioning. I had a query which was passing fine on the MariaDB InnoDB for 15-...
user avatar
6 votes
2 answers
750 views

Optimal engine for small lookup tables in MySQL

I have following question: I am designing web application with several dozens of small lookup tables: These tables usualy contain three columns (ID, Name, Description) and a couple of rows (mostly ...
user avatar
  • 314
3 votes
3 answers
12k views

Migrate Jira to MySql - Unknown system variable 'storage_engine'

I'm migrating JIRA in Windows from HSQL to MySQL and I got stuck with the message Unknown system variable 'storage_engine'. Though I created a backup, installed MySQL and copied J connector to libs ...
user avatar
6 votes
1 answer
4k views

MongoDB 3.0 : Configure storage engine at collection or database level

I know we can configure the storage engine to be wiredTiger at instance level when we start mongod. But can we also select the storage engine to be different for different collection or database?
user avatar
  • 163
0 votes
1 answer
252 views

Change Storage Engine on Referenced Tables

i need to change storage engine from 'InnoDB' to 'MyISAM' on some tables of different databases. So i made a script file to do so: #!/bin/bash DATABASES=$(mysql -u XXXXX -pXXXXX --skip-column-names -...
user avatar
  • 600
2 votes
1 answer
1k views

Mysqli prepare error: Unknown storage engine 'InnoDB'

I'm getting this error on my XenForo installation. Server logs show out of memory because of too many php processes opened up which cause mysqld to shutdown. The WordPress installation associated with ...
user avatar
  • 123
0 votes
0 answers
1k views

I have changed table engines from MyISAM to Aria, should I change the database engine too?

I have changed all tables in my mariadb database from MyISAM to Aria (using adminer as tool), but the database engine is still shown as InnoDB. Should I change this to Aria, too? I did not choose ...
user avatar
  • 161
2 votes
1 answer
455 views

How do I create fractal index using tokudb engine?

I install MariaDb and configured it to use TokuDb Engine. I need to use Fractal-Index Built-in on TokuDb Engine. I have create my index as follow: ALTER TABLE `table__name` ADD INDEX ( `column` ); ...
user avatar
3 votes
1 answer
4k views

How to export mysql databases with different ENGINE?

I'm setting up MySQL Cluster. As it uses ENGINE=NDBCLUSTER, how could I export my databases from MySQL Server specifying the ENGINE? Is there a way to do this? All my tables are MYISAM
user avatar
  • 303
1 vote
1 answer
568 views

Fastest engine for Mass Updates (only updates done on table)

I have a table of 2 columns and 60 million rows. I want to update the table by incrementing one field by 1 on various different rows (This is the only type of operation that will ever be done on the ...
user avatar
1 vote
1 answer
293 views

How Much Resources Does the BLACKHOLE Storage Engine Consume?

I'm going to add a MySQL Relay Slave which use BLACKHOLE Storage Engine. The relay slave will just filter some databases binlog to downstream slave. Our MySQL Master generates about 15G a day in ...
user avatar
  • 113
8 votes
1 answer
1k views

Is it Possible to Recover Data from a BLACKHOLE table? [closed]

I had created table with engine BLACKHOLE basically the BLACKHOLE storage engine acts as a “black hole” that accepts data but throws it away and does not store it. Retrievals always return an empty ...
user avatar
  • 1,167
1 vote
2 answers
5k views

Is there a way to enable MariaDB MEMORY storage engine for every table?

I am new to MariaDB and interested in using it because I want to use MEMORY storage engine for every table. I read MEMORY storage engine on mariadb.com and it seems like I had to specify storage ...
user avatar
  • 161
1 vote
1 answer
2k views

InnoDB to MyISAM Conversion Problem

I have a dedicated server based on CentOS 5 OS , mysql 5 and phpmyadmin I was trying to convert all database tables from InnoDB to MYISAM. I tried to do it by setting in /etc/my.cnf file the value ...
user avatar
0 votes
1 answer
600 views

Aria engine - changing block size

It's possible to change aria_block_size from default 8192 without recreating tables? I want try 1024 or 2048 but after change in my.cnf and restart mariadb I got this errors on aria tables: #138 - ...
user avatar
  • 233
1 vote
1 answer
94 views

Where Mysqldump gets data from

How mysqldump is processing backup? From which all files is it reads data for creating dump? Is the process differs if storage engines are different?
user avatar
0 votes
2 answers
2k views

Inserting into mysql table with archive engine "duplicate key" error

I am trying to archive some files using mysql archive engine. I am using this query to insert file contents: insert into test_table (id,arch) values (123,'FILE_CONTENT') After inserting 2 records, I ...
user avatar
  • 1,529