Searching the text of a collection of documents or free text fields in a database to find those containing a word or combination of words.

learn more… | top users | synonyms

0
votes
2answers
1k views

SQL Server 2012: Full Text Catalog taking up all the disk space

We have created full text catalog and index for a pretty large table. The column on which the index is being created has a datatype of varchar(max). The problem started as soon as we started ...
0
votes
1answer
117 views

Difference between “Table-Incremental” and “Table-Update” for “Population Type” when scheduling Full Text Index Population

I want to schedule a Full Text Index's population to keep it more up to date rather than leaving it to Automatic and not knowing the next population time as the users are complaining about the data ...
3
votes
1answer
515 views

MongoDB text index and text search

I have a mongodb collection db.articles,it has 2 keys ,"title" and "abstract".I want to do text search on these two keys.For example, the search text is "physics",and I want all the documents whose "...
0
votes
3answers
154 views

What is the best way to have full text search where data in database is frequently updated

I am working on an application where database is continuously and periodically gets updated , the frequency of updating of data is daily, weekly, monthly, and yearly based on their type. I want to ...
9
votes
1answer
392 views

Update queries slower after enabling SQL Server Full-Text Index

I have an asp.net website with many insert, update, and delete queries running against my database. A few days ago I create a Full-Text Index on two columns of one of tables. After that I realized ...
2
votes
2answers
295 views

MySQL Escape Characters

I'm getting an SQL error when trying to mix a match against in a SQL statement with a specific character which is not covered by MySQL escape functions in PHP. This is an example: The name to ...
1
vote
1answer
1k views

Slow insert with MySQL full-text index

I use a full-text index in a MySQL table, and each insert into this table takes about 3 seconds. It seems that MySQL rebuilds (a part) of the full text index after each insert/update. Is this right? ...
1
vote
1answer
145 views

SQL Server full text search query takes way too long to execute

I've got query snippet as follows: SELECT * FROM CONTAINSTABLE(dbo.Analysis, *, 'FORMSOF(FREETEXT, "historic year-on-year exchange rates forecast year-on-year exchange rates")'); I'm running it on ...
0
votes
1answer
166 views

Oracle Text: query scoring with CTXCAT index?

If a text column is indexed with a CTXSYS.CONTEXT index it can return a score showing how well the text matches the query. create index ix on t(text) indextype is ctxsys.context parameters (''); ...
1
vote
1answer
15 views

MYSql Full Text Boolean search and relevancy score improvements

I am using a mysql BOOLEAN full text search as shown in the query below and am getting what I think to be bad results that could be more relevant. Query: SELECT phppos_items.name,MATCH (phppos_items....
0
votes
2answers
278 views

List full text indexes in Oracle database

Using SQL Server, it's possible to execute a query that returns all the columns that contain a full text index. How can I do something similar using Oracle? Is it possible?
3
votes
0answers
477 views

SQL Server 2014 - Full text index never stops populating

I have a server that is running SQL Server 2014. I have full text indexes on some of my tables in my databases. The problem is that it's always saying populating and it never finishes. So my queries ...
0
votes
1answer
126 views

Slow mysql query full text search tag database

In the database are ~700k images. Each image has its own tag(s). I want to be able to search images by the tags with a full text search query. The query does exactly what I want but it's very slow. ...
32
votes
5answers
11k views

What database technologies do big search engines use? [closed]

Does anybody knows how Google or Yahoo perform searches for keywords against very very huge amounts of data? What sort of database or technologies do they employ for this? It takes few milliseconds, ...
0
votes
0answers
20 views

What are the best settings of InnoDB for FULLTEXT queries?

This question has been asked before, but I was unable to find the right answer for my situation. We have a local server with Quad core and 32GB RAM dedicated for a single InnoDB database, which ...
0
votes
1answer
28 views

How to use FULLTEXT in mysql innoDB?

Sorry, if my question is naive, but it has puzzled me, and cannot benchmark the performance. I want to use the newly introduced feature of innoDB for FULLTEXT index. I wonder what is the difference ...
0
votes
0answers
10 views

How to weight columns and should I use a dedicated table?

Our website had a full text search that included a title, description, and other fields. Appearing in the title is far more important than appearing in any of the other fields, but the index was ...
1
vote
0answers
19 views

How do I configure Postgresql stop words to reduce to -ism and -ist?

I want to reduce communism and communist to the same stop words. Currently, that's not the way it's working. # select to_tsvector('communism communist'); to_tsvector ----------------...
3
votes
3answers
2k views

How do I use an Ispell dictionary with Postgres text search?

Postgres can use Ispell-compatible dictionaries in text search, but does not provide the required files.
13
votes
1answer
767 views

Guidelines for full-text index maintenance

What guidelines should be considered for maintaining full-text indexes? Should I REBUILD or REORGANIZE the full-text catalog (see BOL)? What is a reasonable maintenance cadence? What heuristics (...
2
votes
0answers
52 views

Why does score for mysql boolean match give different score?

I am attempting to use MySQL's fulltext search using Boolean match on multiple columns, with multiple search phrases. I cannot understand the score returned though. The score returned is typically an ...
0
votes
1answer
25 views

SQL Server FTS get tokens from string

What is the query to get the tokens in a string from SQL Server 2008 R2? I need it to highlight results of FREETEXT
1
vote
0answers
14 views

Synonims in SQL Server 2008 R2 FTS

The Search feature on my website is based on SQL Server's Full Text Search (I insert everything relevant to a single table and this table is in the FTS Catalog). We don't have money to buy a ...
0
votes
1answer
19 views

FullText Search

We came across an issue using FullText Indexes and SQL 2008 R2, not sure if it's by design or I am missing something. When we search using a fulltext index, I noticed SQL appears to trim leading and ...
1
vote
0answers
21 views

full-text search 7608 (0x80004005) error message debug

Someone tries to run the following line : exec sp_fulltext_column 'tbElementFullTextMvCustomProperty5', 'EMVCP_E_NAME', 'add', 0, NULL and then receives the following error : (1 row(s) affected) ...
2
votes
0answers
472 views

Full-Text Index menu option not appearing in SQL Server Management Studio AND error when right clicking a table

I am using SQL Server Management Studio Version 11.0.3128.0 and SQL Server 2014 12.0.2361 Web Edition. I have successfully created a Full Text Catalog following these instructions: Cannot use a ...
4
votes
1answer
67 views

SQL Server: no search results caused by noise words

I've moved a database from SQL Server 2000 to SQL Server 2014 via an import/export through SQL Server 2008 to make it compatible to be imported in 2014. So far that has worked fine. I found out that ...
0
votes
2answers
113 views

Filtering special characters in to_tsquery

This question has been asked before here and here. I want to provide full-text support using postgreSQL via to_tsquery. However, since escaping characters leads to complications, I think it is okay to ...
1
vote
1answer
135 views

FullTextSearch indexing/searching words with special characters

I'm trying to query FullTextSearch indexed column for hashtags SELECT Bio FROM Users WHERE CONTAINS (Bio,'promoter') SELECT Bio FROM Users WHERE CONTAINS (Bio,'#promoter') both results returns the ...
0
votes
1answer
61 views

Full text indexes on big tables

I have a news website where I store my articles in a table that looks like that: Id title data Where data contains the content of the article and is the biggest column in the database by far. ...
1
vote
1answer
51 views

Full text search error: Invalid locale ID was specified

Query involving full text search is generating the following error message after restoring the database to a new server: Invalid locale ID was specified. Please verify that the locale ID is ...
0
votes
1answer
73 views

postgresql custom TEXT SEARCH CONFIGURATION with tsvector_update_trigger

I would like to use a custom text search configuration with tsvector_update_trigger to be able to update tsv field with french dictionary and unaccent. So I did that : CREATE TEXT SEARCH ...
1
vote
1answer
33 views

MySQL indexing issue when trying to search for a part of a string/word

What we're running into: Engine: MySQL. We've been working on a filter where an user can search for a reference number. However, we've ran into an issue with performance on bigger data sets. We ...
3
votes
1answer
91 views

How do I use freetexttable against multiple tables?

I have a database which (amongst other things) contains tables for support tickets. Each ticket has a short summary, as well as a description. Each ticket can have multiple notes, each of which has an ...
3
votes
1answer
83 views

Full text search in XML documents

I would like to do full-text search in XML documents. However, I can't get matches for attribute values (I get a syntax error if I provide the full attribute value including the : and / characters in ...
0
votes
0answers
70 views

Fulltext match against a number doesn't return any results

I have a table containing two columns indexed for fulltext, for example: CREATE TABLE fulltext_search ( id INT(11) AUTO_INCREMENT NOT NULL, name VARCHAR(255) NOT NULL, url VARCHAR(255) NOT NULL,...
0
votes
0answers
50 views

Timeouts on Full-Text Search when using CONTAINS(*, 'value1 OR value2 OR … valueN')

I have an odd problem when using the Full-Text Search in combination with CONTAINS on all columns (without specifying the column where to search). The problem is when I specify more than 5 or 6 values ...
0
votes
0answers
33 views

SQL-Server Full-Text Index Auto-Population Stops Working

From time to time auto population stops working (SQL Server 2014 11.0.6518). I have to use ALTER FULLTEXT INDEX ON [table] RESUME POPULATION to make it work again. In the SQLFT*.LOG there is no ...
2
votes
2answers
245 views

What is more efficient: text (765) or varchar (765) to store a freeform searchable description?

EDIT : To paraphrase quesiton - at what point do I switch from varchar to text and back? A little background on the question. Let's say we have sales_orders table and we want to be able to keep a ...
0
votes
1answer
38 views

A plain text based database [closed]

The list of the files on my hard disks has grown up to a million, the more or less, of records, each consisting of a eigth or ten fields, es. support id - file size - full path name - md5 hash - ...
3
votes
1answer
7k views

GROUP BY and ORDER BY problem

I have two tables like this: CREATE TABLE cmap5 ( name varchar(2000), lexemes tsquery ); and CREATE TABLE IF NOT EXISTS synonyms_all_gin_tsvcolumn ( cid int NOT NULL, -- ...
2
votes
1answer
58 views

Return top 100 words from strings

Not sure this is even possible but I was wondering if there is any way of using PostgreSQL to return the top 100 most occurring words from a database column containing strings of varying lengths? The ...
1
vote
2answers
45 views

Fulltext searching on shared hosting - 2000 Entires with around 500 words each

I'm fairly new to db administration and would appreciate some help. I want to host a site which requires full text search on around 2000 items, each with around 500 words each. I need this to be ...
1
vote
1answer
100 views

Database Design and structure

I want to make colleges search system where a user enter any keywords in a search box and we can provide them some institutes with their details like institutes names, belonging hotspots, cities, and ...
3
votes
2answers
177 views

is it possible to do a reverse pattern search in a database?

I have 2 database tables with rows containing strings. If I combine two strings, one from each table, as input I need to be able to find where the parts of the strings are located in each table. For ...
0
votes
1answer
284 views

mysql MATCH relavancy score

I thought this would be an easy question to google for; but I couldn't not find it. Given the following query: SELECT name, MATCH (name) AGAINST ('vision black*' IN BOOLEAN MODE) as rel FROM (`...
4
votes
2answers
157 views

Integrate MySql Full Text searches in CMS

I'm developing my own CMS and using MySql v5.5 DB to save the content items records. Due to a technical limitations, I can't upgrade my database to a newer version that support Full-Text searches on ...
2
votes
1answer
83 views

Optimized MySQL “optional” FULLTEXT search on multiple tables

I need to select data with optional columns in where clause based on client input. my query is like this: SELECT a.id, a.title, b.txt AS b_txt, c.txt AS c_txt FROM a LEFT JOIN b ON a.b_id=b.id ...
0
votes
0answers
41 views

Where to put snowball files to add a snowball stemmer to PostgreSQL database?

I've downloaded Czech snowball stemmer source files (.c, .h files) and compiled them into .o files and I know the correct SQL syntax for adding the dictionary (it's in the docs). I keep getting the ...
3
votes
2answers
174 views

How to match all words of one column against words in another column

I have two tables. Table A: Company_name ------------------------------- Tata consultancy Infosys tech Atm service Air force firm Table B: Company1_name | Id ----------------...