A question about retrieving performance for simple but bug key-value DBs on python3.
I am working on a pipeline to compare several entries based on key-values (genetic variants found in patients with known variants in different DBs of several GBs for each chromosome) on python3. The most important thing would be performance in retrieving information (as I need to write the DB only once and then just querying it, no updating).
I tried SqliteDict but it performed not so well (sqlitedict retrieve operations performance), I also tried MongoDB but it does not seemed to help. I had a look at redis but it can not be the case due to the DBs dimension and redis in-memory type.
Other ideas to store very big DBs (several GBs) in a key-value NoSql (supposedly faster than Sql) dictionary that can be later vastly retrieved (I hoped SqliteDict to be faster).
Thanks a lot for any help!