Searching the text of a collection of documents or free text fields in a database to find those containing a word or combination of words.

learn more… | top users | synonyms

0
votes
1answer
61 views

mysql fulltext query is very slow

I have one table for User detail in MySql with about 500000 records in it. I have also created fulltext index on firstname, lastname field on this table. but when I am trying to search any single ...
2
votes
2answers
21 views

Fuzzy Matching with Postgresql 9.3

Right now I am using ts_rank (with ts_vector and ts_query) to search strings for relevance. While this is doing a great job for me so far. I was hoping to work in a bit of fuzzieness into the ...
4
votes
1answer
167 views

Fulltext stoplist replication

In MS SQL Server 2008 R2 there is replication of table with fulltext index on it. But stoplist that is associated with replicated fulltext index doesn't replicate. Is there any possibility to ...
0
votes
0answers
17 views

Trying to search using MATCH and AGAINST keyword

// Working $query="SELECT * FROM vehicle WHERE MATCH (body_type) AGAINST ('$selected_btype' IN BOOLEAN MODE) OR MATCH(location) AGAINST ('$selected_location' IN BOOLEAN MODE)"; //Not working ...
3
votes
2answers
1k views

sql server full text search - fuzzy searching?

Is there a way to configure fuzzy searches in sql server full text search. Meaning if I search for a term called POWDER, I must get matches (i.e. strings) which contain any variations of it within an ...
1
vote
0answers
14 views

Skipping stopwords (and indexing small words) for one fulltext index only, in MySQL

I have a rather odd situation where it might be preferable to not use stopwords and to have a value of ft_min_word_len equal to 1. The index in question would be dealing with only a few words per row ...
0
votes
2answers
71 views

SQL Server 2012: Full Text Catalog taking up all the disk space

We have created full text catalog and index for a pretty large table. The column on which the index is being created has a datatype of varchar(max). The problem started as soon as we started ...
4
votes
1answer
288 views

Full-text search with german umlauts

I created a table using German (Germany) as the Full-text language, in the settings I tried setting accent sensitivity to both sensitive and insensitive. I, however, get following odd results. The ...
1
vote
1answer
936 views

Fixing wildcard expansion resulting in too many terms error (DRG-51030)

How can I resolve the wildcard_maxterm problem in Oracle 10g? My index creation syntax is: begin ctx_ddl.drop_preference('SUBSTRING_PREF'); end; / begin ...
1
vote
0answers
28 views

Unsupported languages in Postgres Full text search

My web application supports 3 languages, English, Traditional Chinese, Vietnamese. I understand that Traditional Chinese and Vietnamese is not supported in Postgres' Full Text Search. If I were to go ...
0
votes
0answers
30 views

innodb fulltext Table handler out of memory

I am running mariadb 10 and have a large innodb table with a fulltext index. When searching I am regularly getting this error ERROR 128 (HY000): Table handler out of memory Is there some way I ...
1
vote
1answer
625 views

Slow insert with MySQL full-text index

I use a full-text index in a MySQL table, and each insert into this table takes about 3 seconds. It seems that MySQL rebuilds (a part) of the full text index after each insert/update. Is this right? ...
0
votes
0answers
11 views

period causes results to not display

I have, as an example, the following in a mysql database table: (28,'man vs. wild','discovery',1) Info on my db: mysql 5.5.37 InnoDB utf8_unicode_ci fulltext When I do a search such as this, I ...
1
vote
1answer
185 views

MongoDB text index and text search

I have a mongodb collection db.articles,it has 2 keys ,"title" and "abstract".I want to do text search on these two keys.For example, the search text is "physics",and I want all the documents whose ...
3
votes
1answer
34 views

is it possible to do a reverse pattern search in a database?

I have 2 database tables with rows containing strings. If I combine two strings, one from each table, as input I need to be able to find where the parts of the strings are located in each table. For ...
0
votes
0answers
21 views

Row level security and full text searching

How do you approach the problem of resolving access permissions when matching tens of thousands of users with tens of millions of documents containing unstructured data? How do you even build and ...
5
votes
2answers
353 views

SQL Server Full Text Search - .rtf files incorrectly indexed by rtf tags

I've set up a full-text index on my SQL Server DB on a varbinary(max) column. I have a type column specified, which contains the extension of the file, such a ".doc", ".pdf" etc. However, I have ...
1
vote
1answer
201 views

How to repair all indexes in a MySQL database?

My database got corrupted, and now the php app is throwing this error: Invalid query: Can't find FULLTEXT index matching the column list The error is not very useful, since it doesn't say what ...
0
votes
0answers
22 views

SQL Server 2012 FTS and weird behavior with numbers

I stumbled on this weird behavior in SQL Server's Full text search. First run the following SQL-code in a database: CREATE TABLE test( id int IDENTITY NOT NULL, value VARCHAR(255), CONSTRAINT ...
2
votes
2answers
57 views

Slow fulltext search due to wildly innacurate row estimates

Fulltext queries against this database (storing RT tickets) seem to be taking a very long time to execute. The attachments table (containing the fulltext data) is about 15GB. The database schema is ...
2
votes
1answer
46 views

Which database technologies to consider for a data search application?

I'm designing an application that only does read queries to some database tables (it's a kind of search application); the queried data is updated at night by the system (so speed is less critical, ...
1
vote
1answer
36 views

MySQL FullText search on string shorter than 3 chars returns no rows

I have a MySQL table with some addresses in it. Let's say I have the following 2 rows: "10 Fake Street" "101 Fake Street" I'm trying to use fulltext search with MATCH() AGAINST(). I have set ...
0
votes
1answer
53 views

SQL Server 2008 R2 Express Silent Install - FullText Service Not working

I'm trying to build an installer for an app that installs SQL Server 2008 R2 ADV with fulltext already enabled, but couldn't sort it out. It must support Windows XP, so that's the first OS I'm ...
4
votes
1answer
61 views

Combining full-text and scalar index

Let's say we have a database of 12 million names and addresses that need to be searchable using full-text, but each row contains an integer value too, let's say COMPANYID. The table contains around ...
0
votes
0answers
25 views

Postgresql Full Text Search sequence of strings

What I'm trying to do is that i have a bunch of html documents in which I need to search for certain groups of strings. I did build a ts_vector for all htmls but I seem not be able to find out if it ...
0
votes
0answers
17 views

MySql full text query with truncate sign strange behaviour

I'm implementing a search mechanism on a customer site. I need to find products with "full-text" matching description. However, I noticed a strange behavior. Taking for example two records: (A) ...
0
votes
1answer
73 views

Multi-Column Full Text Search Going Very Slow

I have a full text index on a table articles for the columns content, title and keywords When doing the search on each of the columns, like so select count(1) from articles where ...
2
votes
0answers
21 views

How do I get information about how an index set was created in Oracle?

A long time ago I created a CTXCAT index with an INDEX SET using ctx_ddl.create_index_set and ctx_ddl.add_index but forgot to save the DDL anywhere and now I need to recreate this index on another ...
0
votes
0answers
45 views

Database that supports fast prefix matching

I have a list of potentially millions of url's, e.g. twitter.com/user1, facebook.com/user2. For every incoming other url (10K/s) I want to find the longest prefix match among all the stored url's. ...
0
votes
0answers
38 views

SQL SERVER 2012 Express - Can't change Thesaurus Location

I have a requirement for an application to change the location where SQL SERVER looks for the Global Thesaurus file. According to the official documentation: "You can change the location and names ...
2
votes
1answer
965 views

SQL Server 2008: What are the English Word Breakers?

I'm trying to replicate what SQL Server 2008 is doing when generating full-text indexes, but I'm having a hard time finding a list of which characters SQL Server 2008 considers to be word breakers. ...
5
votes
1answer
76 views

Full Text Search Term Casing Affects Results

I have been experiencing a full text problem when searching using CONTAINS. I have the full text catalog accent sensitive setting set to false. The table contains following rows: Microsoft C# ...
0
votes
1answer
36 views

Which triplestores have support for full-text search

Which RDF triplestores support full-text search and what performance can be expected from them. I am assuming that they will have to extend SPARQL in some way as the only way that I can think of for ...
4
votes
3answers
561 views

Full Text Search With PostgreSQL

i have a table with this rows: Stickers ------------------------------------------------------ ID | Title |Keywords (ts_vector) ------------------------------------------------------ ...
5
votes
2answers
2k views

Postgres full text search with multiple columns, why concat in index and not at runtime?

I've come across full text search in postgres in the last few days, and I am a little confused about indexing when searching across multiple columns. The postgres docs talk about creating a ts_vector ...
0
votes
0answers
58 views

How can I decrease FULLTEXT initialization time?

I'm trying to decrease execution time of the a query. Using SHOW PROFILE, FULLTEXT initialization takes about 0.3, which is too high. Other values are at normal level. How can I decrease FULLTEXT ...
1
vote
0answers
49 views

postgres - generating documents for full text search taking forever and eating up disk space

We use PostgreSQL and Django-Haystack with Elasticsearch for search on our service, and were thinking of switching to Postgres's built in full text search because of various annoyances using a NoSQL ...
1
vote
0answers
77 views

MySQL fulltext selection performance

I have 1.5M rows in a table. Following is the table create code: CREATE TABLE `jobs` ( `id` INT(8) NOT NULL AUTO_INCREMENT, `job_id` VARCHAR(50) NOT NULL DEFAULT '', `title` VARCHAR(255) ...
0
votes
1answer
51 views

Mixed search in multiple columns

I have a table which has a particular column of type JSON, where some user's contact information are stored. I can alter the table and add new columns with cached values to increase search performance ...
0
votes
0answers
49 views

full text index not being updated

I have a table that has a full text index defined on it. Change tracking is set to 'Automatic' but I can see that 'Table Full-Text Pending Changes' is set to '58429', and recently added rows (for the ...
1
vote
1answer
41 views

Troubleshooting vanishing fulltext index in SQL Server 2012

I am trying to get to the bottom of some weirdness. Yesterday I enabled a fulltext index on a table in SQL Server 2012 running on one of our LAN servers. I used the Wizard and set the index to update ...
0
votes
0answers
35 views

Simple full text search on 5000 rows is very slow

I am running this full text search on an indexed view and it is taking 20 seconds to query across 5000 rows and return 0 rows. I believe it has something to with the forward slashes because all other ...
2
votes
1answer
364 views

Does SQL Server 2014 Express, with Advanced Services, actually support full text search?

I've installed SQL Server 2014 Express edition, with advanced services. I was hoping to try out the full-text search features. I read here that full text search is supported by the 2014 express ...
-1
votes
3answers
93 views

Full table scan even after adding index

i have two tables in Oracle 11g server one is partitioned and another is having a 3GB of data. I've added a composite index on both the tables based on the where clause, in the order it appears. The ...
0
votes
2answers
138 views

Full Text Catalog not populating

I just created a full text catalog : Enable full text (right click on db => file => enable ful text indexing) Create catalog (Storage => Fulle text Catalog => New Catalog => "FTCatalog" => OK) Add ...
0
votes
0answers
78 views

What is a good database design (schema) for an article search engine application?

I'm trying to make a article search engine application. There are about 1 million articles that will be stored in the DB. I've tried looking around for some similar examples, but I couldn't find any ...
0
votes
2answers
117 views

Using wildcards in NEAR in a Full Text Search

Let's say I have the following text somewhere in a document stored in an FT indexed table in SQL Server minsitry of education and science I want the query to ensure the words are NEAR, but the ...
1
vote
0answers
43 views

Manual Fulltext index population time in SQL Server 2012

I would like to know if there is a way to see how much time did it take SQL Server 2012 to index all the data in a table? In my example I create the table, create the index and set the population to ...
25
votes
5answers
5k views

What database technologies do big search engines use?

Does anybody knows how Google or Yahoo perform searches for keywords against very very huge amounts of data? What sort of database or technologies do they employ for this? It takes few milliseconds, ...
1
vote
0answers
72 views

CONTAINS does not work with ROW_NUMBER

I have the following query: SELECT RowNumber = ROW_NUMBER() OVER (ORDER BY ID DESC) , ID , Name FROM Clients WHERE CONTAINS (Name, 'Jose') My client table has a single ...