Questions tagged [elasticsearch]
A distributed full text search database, which internally uses Lucene.
37
questions
0
votes
0
answers
37
views
How to use things like Elasticsearch, Meilisearch, etc. alongside a main database (e.g. PostgreSQL)?
I could be missing something obvious because this seems like a fairly basic question, but I haven't been able to find any explicit guidance anywhere on how to integrate Meilisearch/Elasticsearch with ...
- 121
1
vote
0
answers
16
views
Disabling SSL in ElasticSearch and enrolling new nodes
I am trying to start an elasticsearch container with SSL disabled as I want it to be hosted at http://localhost:9200 (not https). With this I want the ability to enroll new nodes. But as I disable the ...
0
votes
0
answers
4
views
Elasticsearch Rack Awarness
I'm in ES 7.17.7 ES.
I have 6BareMetal(BM), each BM will have 4VirtualMachines(VM), each VM's having ES service running and all 5BM are in 3 Physical Racks.
Reason: I dont want Primary and Replica to ...
- 1,521
0
votes
0
answers
8
views
How to Create an ElasticSearch 8 Installation with High Availability on Ubuntu
Today I have an installation of ElasticSearch 6, but due to my lack of knowledge I only installed it on one machine and it lives with Yellow Status.
And in case of updates or upgrades, I can't make ...
- 406
0
votes
1
answer
476
views
How to get current date and time in Elasticsearch
I need to review the current date and time zone from Elasticsearch. I'm checking the elastic documentation and it mentioned that the default value is UTC.
In other environments I use:
SELECT NOW();
...
- 37
0
votes
1
answer
118
views
Secondary indexes vs Using elastic search
When does it make sense to put data in elastic search vs creating secondary indexing on Primary datastore?
Elastic search with another primary store
Pros:
Primary datastore can be optimised for read ...
- 101
0
votes
1
answer
258
views
Developing a database to store 100-dimensional image embeddings along with their paths
Suppose we want to design a database to store images represented in a vector format (each image is stored as a 100-dimensional vector). The goal here is to store image embeddings along with their ...
- 109
0
votes
1
answer
25
views
Are the Informix and Lucene analyzers similar?
Is the analyzer discussed here same as Lucene analyzers? I am confused because most of them show similar properties to Lucene analyzer but the blog posts don't say a word about Lucene; instead they ...
- 13
-1
votes
1
answer
48
views
Room availability [closed]
I was wondering what would the best way to manage availability for rooms or beds like in a hostel (Saas).
I was thinking about using MySQL and Elasticsearch.
What would be the best schema for the ...
- 1
0
votes
0
answers
221
views
Store Elasticsearch shards in separate partitions on data node
I have an Elasticsearch cluster configured with one head node and three data nodes with the number of replicas set to 2. The data nodes are each split into three partitions called /data1 /data2 and /...
- 261
5
votes
4
answers
578
views
Database events but not triggers
This is a question regarding general DB inner workings, not particular to an implementation or paradigm, though answers for certain technologies are welcome.
I am asking if there is a way to listen to ...
0
votes
1
answer
16
views
Help needed with several engines use case [closed]
We are developing an app, aprox 50k RPM read, 1k RPM write, it ask via key and get a JSON.
The search is always made by key.
I'm inclined to use one MySQL 8 table with a Id field and JSON field with ...
- 103
0
votes
1
answer
2k
views
Delete unassigned shards in Elasticsearch
I had an elasticsearch server, which ran in single node mode.
When dataset reached 1TB, I added second node and relocated couple of shards with reroute api.
Now second node has 2 of 5 shards, but ...
- 123
-1
votes
2
answers
322
views
Which database to use when you have a 6 billion of rows inside and need to query rows with from list of IDs? [closed]
We are currently researching our case of storing the road distances between cities. Right now we have 6 billion of those distances.
Our structure right now in SQL Server is that we have a float which ...
1
vote
1
answer
211
views
Query customers attributes
I need to create a system where the user creates dynamic filters based on our customer's attributes. There are more or less 30 possible filters and 30 millions of customers, but the number of customer ...
- 11
1
vote
0
answers
58
views
Elassandra data modeling
In Cassandra, everyone always stresses how important data modeling is, and rightfully so. However, when using Elassandra, we have Elasticsearch baked in. How does should change how we think about ...
- 153
0
votes
1
answer
3k
views
How can I get Elastic IP/host from KIbana interface [closed]
Through Kibana interface, how can I get Elastic IP/host?
I mean, the Elastic host which kibana is connected to.
Is that even possible? i'm struggling on that for hours and I got nothing :(
- 125
0
votes
1
answer
250
views
Use data from Mysql to ElasticSearch with Logstash
I'm using logstash for use my mysql database in ElasticSearch
My conf is the next.
input {
jdbc {
jdbc_connection_string => "jdbc:mysql://[ip]:3306/nextline_dev"
jdbc_user =&...
- 121
1
vote
2
answers
81
views
NoSQL or MySQL for storing API usage
I need to be able to track API usage in order to generate reports or charts later. I've been struggling to decide whether to use regular MySQL or something like MongoDB or Elastic Search which I don't ...
- 113
1
vote
0
answers
15
views
Elastic: Are Analyzers only for `text` type fields?
Most of the documentation about Elastic Analyzers assumes that you NEED an Analyzer and so the documentation talks mostly about how Analyzers work and the differences between the different Analyzers.
...
9
votes
1
answer
3k
views
Combine relational DB and Elastic search
We have a large quanitity of text files we want to free-text/full text search, combined with relational structured metadata about the text file.
So, a search could be "Give me all files that belong to ...
- 271
0
votes
1
answer
2k
views
How to insert several csv files into Elasticsearch?
I have several csv files on university courses that all seem linked by an ID, that you can find here, and I wondered how to put them on Elasticsearch. I know, thanks to this video and Logstash, how to ...
-1
votes
1
answer
203
views
Suggestions for type of DB to use (Elasticsearch vs MongoDB vs Hadoop)
I am hoping some of you highly skilled DBAs can provide some insight as to the best DB to use for this dataset.
This is a relatively simple dataset with no relationship needed between the entries. ...
3
votes
1
answer
7k
views
change analyzer for an elasticsearch index?
I'd like to change the analyzer for an existing index in ElasticSearch, but I can't figure out the syntax (and I'm not grokking the error message).
GET /ccc_test/_mapping
{
"ccc_test": {
"...
- 366
1
vote
1
answer
1k
views
JDBC Sqlserver to elastic search : one input to different output?
I have a sqlserver2016 database that I want to index in elasticsearch using logstash.
Here is my logstash config file which somewhat works :
input {
jdbc {
jdbc_driver_library => "C:\elastic\...
- 1,334
4
votes
2
answers
3k
views
How we can do full text search and facets stuffs on BigQuery?
In the future, we will have millions ofs record in our web product. So we had used BigQuery for data storage and analysis. We have to build filters on our search page like Flipkart and Amazon provide ...
1
vote
0
answers
718
views
Architecture alternatives to solve large table issues in Postgres 9.0
We use PostgreSQL 9.0 for our application and there is a table called events with a lot of metadata columns about event itself. The most important is resource_id that tells for which resource is ...
1
vote
0
answers
74
views
Is it possible to use Kibi with Elasticsearch 5.2?
We are in the process of migrating our MSSQL database to an elasticsearch platform, and have run into the (apparently common) problem of many parents to one child relationship, when trying to access ...
- 111
-1
votes
2
answers
289
views
MongoDB or ElasticSearch
Which one of them is good to use? I'm developing a application which will have the following functionalities.
Multiple users
Each user will have their own database
Data objects will be different; ...
- 79
1
vote
1
answer
517
views
Dedicated tables VS Multipurpose Tables
I am developing a forum like app using a MySQL database. I have posts, comments and replies just any other forum.
At the moment I have a table for posts, a table for comments/replies and a table for ...
- 353
3
votes
1
answer
168
views
On Elasticsearch, what is the required response for a directory URL of a HTTP URL repository?
The official document of Elasticsearch says we can use URL as a setting of Read-only repository. The document also says several protocols, including HTTP, is supported for the URL. (refer: https://www....
- 187
3
votes
1
answer
4k
views
Kibana-like tool for PosgreSQL [closed]
I'm looking for a tool that could browse and visualize data from db like Kibana does.
I'd prefer a native Posgres tool to any that transfers data from a db somewhere else. I know that rivers for ...
- 131
0
votes
2
answers
4k
views
Tracking the update or changes in mysql table
I need to stream the changes to elasticsearch to keep in sync with my database(mysql).
What will be best way to do this ? I have thought for below approaches
Using trigger( but my table will have ...
1
vote
2
answers
180
views
ElasticSearch: is this problem suitable for ElasticSearch DB? [closed]
I have some hardware instruments each one recording a signal and generating sequences of timestamp/value pairs. Timestamp is a basic UTC posix time and value is a double.
I'd like to record such ...
2
votes
1
answer
284
views
Elasticsearch and product characteristics
I have a small question about elasticsearch. Let's say I have a database with products to sell, like an ecommerce.
I know that elasticsearch can help me to find the best product with, for instance a ...
- 167
1
vote
1
answer
2k
views
Elasticsearch: Versioning a document on revisions [closed]
I currently have a document which gets revised regularly, I want to keep track of the document by keeping each old version of the document. So if document A has a summary and update date I want to, ...
- 1,775
1
vote
1
answer
534
views
structure when storing books in elasticsearch
I want to use elasticsearch as a web search engine for books. A book has several editions with different titles in different languages, ISBN's as well as author names in different languages. I want ...
- 111