Questions tagged [elasticsearch]

A distributed full text search database, which internally uses Lucene.

Filter by
Sorted by
Tagged with
1
vote
1answer
1k views

How to insert several csv files into Elasticsearch?

I have several csv files on university courses that all seem linked by an ID, that you can find here, and I wondered how to put them on Elasticsearch. I know, thanks to this video and Logstash, how to ...
0
votes
1answer
13 views

Delete unassigned shards in Elasticsearch

I had an elasticsearch server, which ran in single node mode. When dataset reached 1TB, I added second node and relocated couple of shards with reroute api. Now second node has 2 of 5 shards, but ...
0
votes
2answers
79 views

Which database to use when you have a 6 billion of rows inside and need to query rows with from list of IDs? [closed]

We are currently researching our case of storing the road distances between cities. Right now we have 6 billion of those distances. Our structure right now in SQL Server is that we have a float which ...
1
vote
1answer
1k views

Elasticsearch: Versioning a document on revisions

I currently have a document which gets revised regularly, I want to keep track of the document by keeping each old version of the document. So if document A has a summary and update date I want to, ...
2
votes
1answer
80 views

Query customers attributes

I need to create a system where the user creates dynamic filters based on our customer's attributes. There are more or less 30 possible filters and 30 millions of customers, but the number of customer ...
0
votes
1answer
156 views

Use data from Mysql to ElasticSearch with Logstash

I'm using logstash for use my mysql database in ElasticSearch My conf is the next. input { jdbc { jdbc_connection_string => "jdbc:mysql://[ip]:3306/nextline_dev" jdbc_user =&...
0
votes
0answers
8 views

Elasticsearch Rack Awarness Doesn't seem to work

I have 5Baremetals, each Baremetal is cut into 2VMs and installed ES 6.8. I made the setting on an existing cluster that shouldn't have Primary and Replica on same BM(Baremetal) and I have mentioned ...
1
vote
0answers
20 views

Elassandra data modeling

In Cassandra, everyone always stresses how important data modeling is, and rightfully so. However, when using Elassandra, we have Elasticsearch baked in. How does should change how we think about ...
0
votes
0answers
29 views

Fastest way to make full text searches through 2 columns?

I actually have 200 GB of data indexed on MongoDB, spread over 2 columns, each containing one string. The user search for 'cowboy', if this string is found anywhere, it returns the content. i.e: ...
0
votes
0answers
13 views

What can I do to diagnose where data inaccuracies in my ElasticSearch stack on AWS are coming from?

Context I'm running an ElasticSearch stack on AWS. Data flows as follows: Web client (user's browser) AWS API endpoint AWS Firehose AWS Kinesis AWS Lambda (transforms the data) AWS ElasticSearch My ...
0
votes
1answer
45 views

How can I get Elastic IP/host from KIbana interface [closed]

Through Kibana interface, how can I get Elastic IP/host? I mean, the Elastic host which kibana is connected to. Is that even possible? i'm struggling on that for hours and I got nothing :(
0
votes
0answers
273 views

ElasticSearch Node Failure or Shard Failure?

My Elasticsearch cluster dropped from 2B documents to 900M Records, on AWS it shows Relocating shards: 4 Whilst Showing Active Shards: 35 and Active primary shards: 34 (Might not be relevant but ...
3
votes
2answers
1k views

How we can do full text search and facets stuffs on BigQuery?

In the future, we will have millions ofs record in our web product. So we had used BigQuery for data storage and analysis. We have to build filters on our search page like Flipkart and Amazon provide ...
2
votes
1answer
4k views

change analyzer for an elasticsearch index?

I'd like to change the analyzer for an existing index in ElasticSearch, but I can't figure out the syntax (and I'm not grokking the error message). GET /ccc_test/_mapping { "ccc_test": { "...
1
vote
2answers
56 views

NoSQL or MySQL for storing API usage

I need to be able to track API usage in order to generate reports or charts later. I've been struggling to decide whether to use regular MySQL or something like MongoDB or Elastic Search which I don't ...
1
vote
0answers
10 views

Elastic: Are Analyzers only for `text` type fields?

Most of the documentation about Elastic Analyzers assumes that you NEED an Analyzer and so the documentation talks mostly about how Analyzers work and the differences between the different Analyzers. ...
8
votes
1answer
2k views

Combine relational DB and Elastic search

We have a large quanitity of text files we want to free-text/full text search, combined with relational structured metadata about the text file. So, a search could be "Give me all files that belong to ...
-1
votes
1answer
154 views

Suggestions for type of DB to use (Elasticsearch vs MongoDB vs Hadoop)

I am hoping some of you highly skilled DBAs can provide some insight as to the best DB to use for this dataset. This is a relatively simple dataset with no relationship needed between the entries. ...
1
vote
1answer
961 views

JDBC Sqlserver to elastic search : one input to different output?

I have a sqlserver2016 database that I want to index in elasticsearch using logstash. Here is my logstash config file which somewhat works : input { jdbc { jdbc_driver_library => "C:\elastic\...
0
votes
2answers
2k views

Tracking the update or changes in mysql table

I need to stream the changes to elasticsearch to keep in sync with my database(mysql). What will be best way to do this ? I have thought for below approaches Using trigger( but my table will have ...
1
vote
0answers
378 views

Architecture alternatives to solve large table issues in Postgres 9.0

We use PostgreSQL 9.0 for our application and there is a table called events with a lot of metadata columns about event itself. The most important is resource_id that tells for which resource is ...
1
vote
0answers
69 views

Is it possible to use Kibi with Elasticsearch 5.2?

We are in the process of migrating our MSSQL database to an elasticsearch platform, and have run into the (apparently common) problem of many parents to one child relationship, when trying to access ...
-1
votes
2answers
229 views

MongoDB or ElasticSearch

Which one of them is good to use? I'm developing a application which will have the following functionalities. Multiple users Each user will have their own database Data objects will be different; ...
1
vote
1answer
377 views

Dedicated tables VS Multipurpose Tables

I am developing a forum like app using a MySQL database. I have posts, comments and replies just any other forum. At the moment I have a table for posts, a table for comments/replies and a table for ...
2
votes
1answer
123 views

On Elasticsearch, what is the required response for a directory URL of a HTTP URL repository?

The official document of Elasticsearch says we can use URL as a setting of Read-only repository. The document also says several protocols, including HTTP, is supported for the URL. (refer: https://www....
1
vote
1answer
435 views

structure when storing books in elasticsearch

I want to use elasticsearch as a web search engine for books. A book has several editions with different titles in different languages, ISBN's as well as author names in different languages. I want ...
3
votes
1answer
4k views

Kibana-like tool for PosgreSQL [closed]

I'm looking for a tool that could browse and visualize data from db like Kibana does. I'd prefer a native Posgres tool to any that transfers data from a db somewhere else. I know that rivers for ...
1
vote
2answers
172 views

ElasticSearch: is this problem suitable for ElasticSearch DB? [closed]

I have some hardware instruments each one recording a signal and generating sequences of timestamp/value pairs. Timestamp is a basic UTC posix time and value is a double. I'd like to record such ...
1
vote
1answer
254 views

Elasticsearch and product characteristics

I have a small question about elasticsearch. Let's say I have a database with products to sell, like an ecommerce. I know that elasticsearch can help me to find the best product with, for instance a ...