Questions tagged [full-text-search]

Searching the text of a collection of documents or free text fields in a database to find those containing a word or combination of words.

Filter by
Sorted by
Tagged with
1
vote
1answer
72 views

Index that mimics full-text-index

I have a database that is retrieving information quite slowly, I asked a question and was told to use full-text-indexing, this worked, but now we switched over to a .sdf file and Sql Server Compact ...
1
vote
1answer
216 views

What causes temporary slow (fulltext) queries?

I logged this slow query on a 400k rows MySQL 5.6 InnoDB table: SELECT SQL_NO_CACHE topic_id FROM topics_search WHERE host_id = 1 AND forum_id IN (23, 50) AND MATCH(topic_text)...
1
vote
1answer
138 views

How to search for compound words, and get the word parts returned

I need to be able to search for compound words like "menneskerettighedsforkæmperens" (the human rights activist's) and find the words "menneske" (human), "rettighed" (right) and "forkæmper" (activist)....
0
votes
1answer
124 views

MySQL indexing issue when trying to search for a part of a string/word

What we're running into: Engine: MySQL. We've been working on a filter where an user can search for a reference number. However, we've ran into an issue with performance on bigger data sets. We ...
10
votes
2answers
8k views

Better approach for “LIKE OR LIKE, OR LIKE, OR LIKE, OR LIKE”

In this question he's having the same problem as I am. I need something like: select * from blablabla where product like '%rock%' or like '%paper%' or like '%scisor%' or like '%car%' or like '%...
0
votes
1answer
111 views

PostgreSQL full-text search retrival from id gap

I have a full-text search column on one of my tables in PostgreSQL 9.3 implemented based on this tutorial (without the South part). There is a postgres function where I SELECT concat_ws(' ', a."...
0
votes
1answer
83 views

MySQL - fine-tuning full-text search

How can I fine tune MySQL full-text search for my information domain? For example, I might have a keyword like js that I would like the search to recognize, but I don't think allow a minimum word ...
0
votes
0answers
17 views

Full text sql server strange results

I have 2 documents let's say A ( word document) and b ( pdf version ) stored as blob and full text search enabled. I have 2 words which are present in both documents. Searching for the first word ...
0
votes
1answer
265 views

MYSql Full Text Boolean search and relevancy score improvements

I am using a mysql BOOLEAN full text search as shown in the query below and am getting what I think to be bad results that could be more relevant. Query: SELECT phppos_items.name,MATCH (phppos_items....
1
vote
1answer
82 views

Mysql full text search with other indexed data

After getting some mysql optimization advice in this question. Was able to get the performance to the acceptable levels (when performing lookups using EventType and event_log_domain_id combo). To ...
0
votes
1answer
209 views

Query Quill-Delta JSON array in Postgres

I need to store text in Quill-Delta format, which is in the form of a JSON array, e.g. ----------------------------------------------------------------- | id | title | content ...
3
votes
1answer
4k views

Creating a case-insensitive and accent/diacritics insensitive search on a field

I would like to know if it makes sense to create an index combining two functions while using Full Text Search: lower(name) and f_unaccent(name) Where f_unaccent is just my wrapper to make unaccent ...
2
votes
1answer
70 views

Different execution plans in SQL Server for same query but different offset

I am doing performance experiments regarding the fulltext search feature of Microsoft SQL Server using the stackoverflow database. I have a (seemingly simple) query that results in different ...
0
votes
1answer
31 views

PostgreSQL full text search words delimiter

Please help me to understand how to change words delimiter when I use gin index. The problem is that "," ";" and " " signs are words delimiters but the "." isn't. So in phrase "Some 11.22.33.44 IP" I ...
0
votes
0answers
26 views

Fastest way to make full text searches through 2 columns?

I actually have 200 GB of data indexed on MongoDB, spread over 2 columns, each containing one string. The user search for 'cowboy', if this string is found anywhere, it returns the content. i.e: ...
4
votes
4answers
4k views

How do I use an Ispell dictionary with Postgres text search?

Postgres can use Ispell-compatible dictionaries in text search, but does not provide the required files.
0
votes
1answer
228 views

Filtering out duplicate domains from URL column using Postgres full-text search parsers

I have a PostgreSQL database containing pages and links downloaded by a web crawler, with the following tables: pages ---------- id: Integer (primary key) url: String (unique) title:...
1
vote
1answer
476 views

SQL Server crash with Reason 0x00000006 after a while on linux

Environment OS Ubuntu 16.04 x86_64 (also happening on Windows) DB SQL Server 2017 with FullText Search module (mssql-server and mssql-server-fts packages) Problem The issue that I'm facing is ...
0
votes
1answer
18 views

keyset pagination on extended query with full text search in postgresql

I have a database with 4 tables. These 4 tables hold users, their relations with each other (users following other users), the posts they make and the likes they receive. I have simplified the tables ...
1
vote
1answer
95 views

Multi language full text search using postgresql

I am trying to implement full text search using postgresql for some images. I am storing some information about my images into a json field in my table. This json has a tags key where I have multiple ...
7
votes
1answer
165 views

Disable full-text logging (SQL Server)

Any way to disable FT logs completely? I spent hours googling - no luck. I get tons of "informational" messages literally every second. 2020-01-01 10:43:16.48 spid33s Informational: Full-text ...
0
votes
1answer
37 views

What's the best way to go about searching for short names?

I have a table that has CHAR in Korean for Soccer player names. All of these are under 12 characters, and while LIKE "%name%" works, Slight mistypes or variations don't work, and I've heard that LIKE ...
1
vote
1answer
1k views

How to find cause of SQL-Server Full-Text Index Auto-Population Error?

I have recently added a few full text indices to a database and AUTO populating is not working as I would have expected. Sample Table Definition CREATE TABLE [wrk].[WorkOrder] ( [id] ...
0
votes
1answer
453 views

Full text indexes on big tables

I have a news website where I store my articles in a table that looks like that: Id title data Where data contains the content of the article and is the biggest column in the database by far. ...
3
votes
2answers
3k views

Full text search using words stored in another table

Is there a way to do a full-text search using words stored in another table? This is my scenario: Table_A contains phrases entered by users in field "UserInput" (and other stuff). I have a full-...
1
vote
1answer
760 views

How to get lexemes array from Postgresql ts_vector, sorted by lexems positional information?

Postgresql full text search to_tsvector() function returns a sorted array of lexemes. I need exactly the same function, but returning unsorted array of lexemes. Is there any such postgresql function ...
1
vote
1answer
164 views

Get stopwords of a InnoDB fulltext index

I can set stopwords for a MySQL fulltext index with SET innodb_ft_user_stopword_table ... before creating the fulltext index. But how can I figure out the existing stopwords of before created ...
0
votes
2answers
1k views

Slow mysql query full text search tag database

In the database are ~700k images. Each image has its own tag(s). I want to be able to search images by the tags with a full text search query. The query does exactly what I want but it's very slow. ...
1
vote
1answer
273 views

Full text search on larger text rows

I am wondering what is the best practice to use the right query in my case. The problem is I tried the LIKE and ILIKE and it was faster then pg_trgm and the postgres full text search, because they ...
5
votes
1answer
897 views

Optimized MySQL “optional” FULLTEXT search on multiple tables

I need to select data with optional columns in where clause based on client input. my query is like this: SELECT a.id, a.title, b.txt AS b_txt, c.txt AS c_txt FROM a LEFT JOIN b ON a.b_id=b.id ...
0
votes
2answers
47 views

How to speed up full text query on a table with 4 million rows? (MariaDB)

I have an InnoDB full text table that serves the ajax-powered searchbox at the top of my website. I generate it with a daily script that pulls data from a dozen entity tables on the site, and ...
0
votes
1answer
109 views

Why is my Mac install of Postgres not tokenising Thai words?

On my Mac install of PG: =# select to_tsvector('english', 'abcd สวัสดี'); to_tsvector ------------- 'abcd':1 (1 row) =# select * from ts_debug('hello สวัสดี'); alias | description | token ...
4
votes
2answers
782 views

Performance problem using mysql fulltext search

I have a fulltext index on a column that contains an absolute file path (file_path), for a file indexing application. There are 500 000 rows in the table. The MySQL version is 5.7.19. Most, if not ...
1
vote
1answer
511 views

The fulltext filter daemon host (FDHost) process stops abnormally on SQL Alwayson Cluster

We added a new SQL Always-On Cluster (FCI) 2017 and some of the databases needed full text filter service. So we also added that feature to the install. Ever since we did that we have been getting ...
0
votes
1answer
24 views

SQL Server Full-text search for keywords without prefix matching

I have the following text in my NVARCHAR column "Ich bin eine SuperbProdukt" I have a full-text search enabled on the column and I can search for it by executing the following query that I wrote :...
0
votes
1answer
307 views

The performance of mysql fulltext depend on order of keyword

I am having problem with mysql fulltext search. When I change the order of keyword, the search speed changes. For example I have 4 queries, all of them return same result: FAST (1s) SELECT * FROM ...
2
votes
2answers
242 views

SQL Server Full-text population deadlock

I've created a full-text index on a non-persisted computed column in a table (details here). However, every couple days, the population gets deadlocked and stopped. Specifically: DESCRIPTION: A ...
4
votes
2answers
7k views

Find rows with similar string values

I have a Microsoft SQL Server 2012 database table with around 7 million crowd-sourced records, primarily containing a string name value with some related details. For nearly every record it seems ...
2
votes
1answer
65 views

PostgreSQL text search email parser does not handle + correctly

Default email parser does not parse emails with plus symbol (tested on 11.5): For test@example.com it works fine: select ts_debug('test@example.com'); +-----------------------------------------------...
0
votes
1answer
27 views

How to rank the product higher and the accessories lower? (MySql fulltext search)

I hope this is not a silly question. I have a table containg the products of an online store. I am using fulltext search in boolean mode. People search for, let us say, Apple iPhone 11. I don't ...
0
votes
1answer
35 views

Full text search over multiple CPU processes?

Is it possible to configure Postgres to split out a full text search over multiple CPU processes in an attempt to complete quicker? I'm running a full text search on 2 million records on a GIN ...
0
votes
0answers
33 views

FTS is slower on tsvector than text

I tested the performance of searches on two columns : text, tsvector. Somehow it appears that tsvector is slower than text. Also, there's some incosistency with planning time and execution time. It ...
1
vote
1answer
45 views

When might a tsvector field pay for itself?

I've been experimenting with tsvector indexes for Full Text Search, and see that it's a common practice to generate an store a vector in a column of type tsvector. We're on Postgres 11.4, but I've ...
1
vote
0answers
90 views

Creating a custom thesaurus dictionary on RDS

We're deployed on RDS using Postgres 11.4, and I'm hoping that there is some way to define a custom thesaurus dictionary. I think the answer is a hard no, based on this StackOverflow thread and this ...
1
vote
1answer
127 views

Postgres full text search on words, not lexemes

I've got a table with columns of text that I'd like to search by word, not lexeme. More to the point, that I'd like to have indexed by word rather than lexeme. We've got error dumps with a lot of code ...
0
votes
2answers
117 views

MariaDB FULLTEXT search with apostrophe, and mandatory words

An apostrophe / single quote (') should be part of a word in a FULLTEXT index. Admittedly I can't find this on the MariaDB website, but I'm assuming it should still behave like MySQL (version 5.5). ...
0
votes
1answer
128 views

Postgres text column too large for an index - searching for IP address, so I don't think text search will work

I have a Postgres database with a column that has a large amount of text in it. There are potentially multiple IP addresses in the text, as well as a lot of other text. I need to do a query WHERE ...
1
vote
2answers
235 views

`CHANGE_TRACKING = AUTO` fails to populate full-text index

I have created full-text indexes on tables with the following options (simplified): CREATE FULLTEXT INDEX ON [schema].[table] ( ColumnA Language 'English', ColumnB Language 'English' ) ...
1
vote
1answer
59 views

Exact behaviour of CHANGE_TRACKING AUTO

I am trying to understand population options for SQl server's full text indexes. My target is to access whether our currently used option (default = CHANGE_TRACKING AUTO) is the best to use in our ...
1
vote
1answer
28 views

Converting and removing full text files

I have a database that was created many SQL Server versions ago that has Full Text files. It is currently on a SQL 2012 server. How can I confirm that there is no data in use in the Full Text index ...

1
2 3 4 5
10