Searching the text of a collection of documents or free text fields in a database to find those containing a word or combination of words.

learn more… | top users | synonyms

0
votes
0answers
24 views

innodb fulltext Table handler out of memory

I am running mariadb 10 and have a large innodb table with a fulltext index. When searching I am regularly getting this error ERROR 128 (HY000): Table handler out of memory Is there some way I ...
1
vote
1answer
614 views

Slow insert with MySQL full-text index

I use a full-text index in a MySQL table, and each insert into this table takes about 3 seconds. It seems that MySQL rebuilds (a part) of the full text index after each insert/update. Is this right? ...
0
votes
0answers
11 views

period causes results to not display

I have, as an example, the following in a mysql database table: (28,'man vs. wild','discovery',1) Info on my db: mysql 5.5.37 InnoDB utf8_unicode_ci fulltext When I do a search such as this, I ...
1
vote
1answer
172 views

MongoDB text index and text search

I have a mongodb collection db.articles,it has 2 keys ,"title" and "abstract".I want to do text search on these two keys.For example, the search text is "physics",and I want all the documents whose ...
3
votes
1answer
33 views

is it possible to do a reverse pattern search in a database?

I have 2 database tables with rows containing strings. If I combine two strings, one from each table, as input I need to be able to find where the parts of the strings are located in each table. For ...
0
votes
0answers
17 views

Row level security and full text searching

How do you approach the problem of resolving access permissions when matching tens of thousands of users with tens of millions of documents containing unstructured data? How do you even build and ...
5
votes
2answers
342 views

SQL Server Full Text Search - .rtf files incorrectly indexed by rtf tags

I've set up a full-text index on my SQL Server DB on a varbinary(max) column. I have a type column specified, which contains the extension of the file, such a ".doc", ".pdf" etc. However, I have ...
1
vote
1answer
194 views

How to repair all indexes in a MySQL database?

My database got corrupted, and now the php app is throwing this error: Invalid query: Can't find FULLTEXT index matching the column list The error is not very useful, since it doesn't say what ...
0
votes
0answers
19 views

SQL Server 2012 FTS and weird behavior with numbers

I stumbled on this weird behavior in SQL Server's Full text search. First run the following SQL-code in a database: CREATE TABLE test( id int IDENTITY NOT NULL, value VARCHAR(255), CONSTRAINT ...
4
votes
1answer
159 views

Fulltext stoplist replication

In MS SQL Server 2008 R2 there is replication of table with fulltext index on it. But stoplist that is associated with replicated fulltext index doesn't replicate. Is there any possibility to ...
2
votes
2answers
50 views

Slow fulltext search due to wildly innacurate row estimates

Fulltext queries against this database (storing RT tickets) seem to be taking a very long time to execute. The attachments table (containing the fulltext data) is about 15GB. The database schema is ...
3
votes
2answers
925 views

sql server full text search - fuzzy searching?

Is there a way to configure fuzzy searches in sql server full text search. Meaning if I search for a term called POWDER, I must get matches (i.e. strings) which contain any variations of it within an ...
2
votes
1answer
43 views

Which database technologies to consider for a data search application?

I'm designing an application that only does read queries to some database tables (it's a kind of search application); the queried data is updated at night by the system (so speed is less critical, ...
0
votes
1answer
29 views

MySQL FullText search on string shorter than 3 chars returns no rows

I have a MySQL table with some addresses in it. Let's say I have the following 2 rows: "10 Fake Street" "101 Fake Street" I'm trying to use fulltext search with MATCH() AGAINST(). I have set ...
0
votes
1answer
47 views

SQL Server 2008 R2 Express Silent Install - FullText Service Not working

I'm trying to build an installer for an app that installs SQL Server 2008 R2 ADV with fulltext already enabled, but couldn't sort it out. It must support Windows XP, so that's the first OS I'm ...
4
votes
1answer
57 views

Combining full-text and scalar index

Let's say we have a database of 12 million names and addresses that need to be searchable using full-text, but each row contains an integer value too, let's say COMPANYID. The table contains around ...
4
votes
1answer
277 views

Full-text search with german umlauts

I created a table using German (Germany) as the Full-text language, in the settings I tried setting accent sensitivity to both sensitive and insensitive. I, however, get following odd results. The ...
0
votes
0answers
24 views

Postgresql Full Text Search sequence of strings

What I'm trying to do is that i have a bunch of html documents in which I need to search for certain groups of strings. I did build a ts_vector for all htmls but I seem not be able to find out if it ...
0
votes
0answers
13 views

MySql full text query with truncate sign strange behaviour

I'm implementing a search mechanism on a customer site. I need to find products with "full-text" matching description. However, I noticed a strange behavior. Taking for example two records: (A) ...
1
vote
1answer
882 views

Fixing wildcard expansion resulting in too many terms error (DRG-51030)

How can I resolve the wildcard_maxterm problem in Oracle 10g? My index creation syntax is: begin ctx_ddl.drop_preference('SUBSTRING_PREF'); end; / begin ...
0
votes
1answer
57 views

Multi-Column Full Text Search Going Very Slow

I have a full text index on a table articles for the columns content, title and keywords When doing the search on each of the columns, like so select count(1) from articles where ...
2
votes
0answers
20 views

How do I get information about how an index set was created in Oracle?

A long time ago I created a CTXCAT index with an INDEX SET using ctx_ddl.create_index_set and ctx_ddl.add_index but forgot to save the DDL anywhere and now I need to recreate this index on another ...
0
votes
0answers
45 views

Database that supports fast prefix matching

I have a list of potentially millions of url's, e.g. twitter.com/user1, facebook.com/user2. For every incoming other url (10K/s) I want to find the longest prefix match among all the stored url's. ...
0
votes
0answers
34 views

SQL SERVER 2012 Express - Can't change Thesaurus Location

I have a requirement for an application to change the location where SQL SERVER looks for the Global Thesaurus file. According to the official documentation: "You can change the location and names ...
2
votes
1answer
948 views

SQL Server 2008: What are the English Word Breakers?

I'm trying to replicate what SQL Server 2008 is doing when generating full-text indexes, but I'm having a hard time finding a list of which characters SQL Server 2008 considers to be word breakers. ...
5
votes
1answer
75 views

Full Text Search Term Casing Affects Results

I have been experiencing a full text problem when searching using CONTAINS. I have the full text catalog accent sensitive setting set to false. The table contains following rows: Microsoft C# ...
0
votes
1answer
36 views

Which triplestores have support for full-text search

Which RDF triplestores support full-text search and what performance can be expected from them. I am assuming that they will have to extend SPARQL in some way as the only way that I can think of for ...
4
votes
3answers
549 views

Full Text Search With PostgreSQL

i have a table with this rows: Stickers ------------------------------------------------------ ID | Title |Keywords (ts_vector) ------------------------------------------------------ ...
5
votes
2answers
2k views

Postgres full text search with multiple columns, why concat in index and not at runtime?

I've come across full text search in postgres in the last few days, and I am a little confused about indexing when searching across multiple columns. The postgres docs talk about creating a ts_vector ...
0
votes
0answers
49 views

How can I decrease FULLTEXT initialization time?

I'm trying to decrease execution time of the a query. Using SHOW PROFILE, FULLTEXT initialization takes about 0.3, which is too high. Other values are at normal level. How can I decrease FULLTEXT ...
1
vote
0answers
42 views

postgres - generating documents for full text search taking forever and eating up disk space

We use PostgreSQL and Django-Haystack with Elasticsearch for search on our service, and were thinking of switching to Postgres's built in full text search because of various annoyances using a NoSQL ...
1
vote
0answers
60 views

MySQL fulltext selection performance

I have 1.5M rows in a table. Following is the table create code: CREATE TABLE `jobs` ( `id` INT(8) NOT NULL AUTO_INCREMENT, `job_id` VARCHAR(50) NOT NULL DEFAULT '', `title` VARCHAR(255) ...
0
votes
1answer
43 views

Mixed search in multiple columns

I have a table which has a particular column of type JSON, where some user's contact information are stored. I can alter the table and add new columns with cached values to increase search performance ...
0
votes
0answers
34 views

full text index not being updated

I have a table that has a full text index defined on it. Change tracking is set to 'Automatic' but I can see that 'Table Full-Text Pending Changes' is set to '58429', and recently added rows (for the ...
1
vote
1answer
38 views

Troubleshooting vanishing fulltext index in SQL Server 2012

I am trying to get to the bottom of some weirdness. Yesterday I enabled a fulltext index on a table in SQL Server 2012 running on one of our LAN servers. I used the Wizard and set the index to update ...
0
votes
1answer
38 views

mysql fulltext query is very slow

I have one table for User detail in MySql with about 500000 records in it. I have also created fulltext index on firstname, lastname field on this table. but when I am trying to search any single ...
0
votes
0answers
33 views

Simple full text search on 5000 rows is very slow

I am running this full text search on an indexed view and it is taking 20 seconds to query across 5000 rows and return 0 rows. I believe it has something to with the forward slashes because all other ...
2
votes
1answer
260 views

Does SQL Server 2014 Express, with Advanced Services, actually support full text search?

I've installed SQL Server 2014 Express edition, with advanced services. I was hoping to try out the full-text search features. I read here that full text search is supported by the 2014 express ...
-1
votes
3answers
85 views

Full table scan even after adding index

i have two tables in Oracle 11g server one is partitioned and another is having a 3GB of data. I've added a composite index on both the tables based on the where clause, in the order it appears. The ...
0
votes
2answers
115 views

Full Text Catalog not populating

I just created a full text catalog : Enable full text (right click on db => file => enable ful text indexing) Create catalog (Storage => Fulle text Catalog => New Catalog => "FTCatalog" => OK) Add ...
0
votes
0answers
73 views

What is a good database design (schema) for an article search engine application?

I'm trying to make a article search engine application. There are about 1 million articles that will be stored in the DB. I've tried looking around for some similar examples, but I couldn't find any ...
0
votes
2answers
97 views

Using wildcards in NEAR in a Full Text Search

Let's say I have the following text somewhere in a document stored in an FT indexed table in SQL Server minsitry of education and science I want the query to ensure the words are NEAR, but the ...
1
vote
0answers
40 views

Manual Fulltext index population time in SQL Server 2012

I would like to know if there is a way to see how much time did it take SQL Server 2012 to index all the data in a table? In my example I create the table, create the index and set the population to ...
25
votes
5answers
5k views

What database technologies do big search engines use?

Does anybody knows how Google or Yahoo perform searches for keywords against very very huge amounts of data? What sort of database or technologies do they employ for this? It takes few milliseconds, ...
1
vote
0answers
68 views

CONTAINS does not work with ROW_NUMBER

I have the following query: SELECT RowNumber = ROW_NUMBER() OVER (ORDER BY ID DESC) , ID , Name FROM Clients WHERE CONTAINS (Name, 'Jose') My client table has a single ...
0
votes
0answers
27 views

Searching larger documents

I'm currently developing an application where I want to use MongoDB for the main database. I'm trying to store the emails metadata inside the database. My schema: user_id (integer 32bit) -- index ...
1
vote
1answer
38 views

capability and performance of tags implemented as array vs text vs full text

In terms of search capability and performance, what are the pros & cons of implementing tags as an array or text or full text field? I am seeing limitations of capability in choosing to implement ...
2
votes
1answer
291 views

SQL Server Full-Text Search: combining proximity term and thesaurus

Scenario I am developing a full-text search over a products table. The full-text indexed field of th table contains a brief description of the product, the name of the category and the product code. ...
1
vote
1answer
129 views

DTC Timeout when trying to update oracle table through link that contains a text index

Problem Given is a SQL Server connected to an ORACLE Instance as a Linked Server. It’s using the Oracle Client OLEDB Provider. When doing an update in a transaction on a table having a CTXSYS.CONTEXT ...
3
votes
2answers
372 views

What characters are word breakers in English for SQL Server 2005 and 2008 R2?

I can find what DLL supports English word breakers by using sp_help_fulltext_system_components but I have not been able to find an actual list of the word breaking characters for English (like blank, ...