Searching the text of a collection of documents or free text fields in a database to find those containing a word or combination of words.

learn more… | top users | synonyms

1
vote
1answer
721 views

postgres GROUP BY and ORDER BY problem

I have two tables like this: CREATE TABLE cmap5 ( name VARCHAR(2000), lexemes TSQUERY ); and CREATE TABLE IF NOT EXISTS synonyms_all_gin_tsvcolumn ( cid int NOT NULL ...
0
votes
1answer
358 views

slow queries - set weight to token type in tsquery - postgresql

Postgresql version 9.2.3! I'm working on a database for mapping of chemical names. My main table contains aprox 91 million records and it's indexed by gin. I want to query it with multiple names (I'm ...
1
vote
1answer
164 views

Avoiding performance hit from GROUP BY during FULLTEXT search?

Is there any clever way to avoid the performance hit from using group by during fulltext search? SELECT p.topic_id, min(p.post_id) FROM forum_posts AS p WHERE MATCH (p.post_text) AGAINST ('baby ...
2
votes
1answer
102 views

Are there differences in performance of getting data between FullText Search and indexed columns

In SQL Server 2008 R2 I have a query which looks like create stored procedure give_me_art @filter varchar(15),@skl_id int begin select id,naziv,sifra,isnull(lager.kolicina,0) as lager from art ...
1
vote
1answer
820 views

Why does MATCH() give Score 0, if there are less rows in the database?

I followed this example from the Mysql Documentation: CREATE TABLE articles ( id INT UNSIGNED AUTO_INCREMENT NOT NULL PRIMARY KEY, title VARCHAR(200), body TEXT, FULLTEXT ...
1
vote
1answer
307 views

Installing Full Text Search on SQL Server 2008 R2 Express

I can't for the life of me install full text search on my SQL Server 2008 R2 instance. Every installer I have tried shows me this: I've tried: SQLEXPRADV_x64_ENU.exe SQLEXPRWT_x64_ENU.exe ...
1
vote
0answers
49 views

Fulltext indexes and issuers with server startup

I have a windows server for host about 4500 data bases for same application. And this application have 34 fulltext catalogs on it, and the CHANGE_TRACKING for this fulltext index are AUTO. And the ...
4
votes
1answer
2k views

Using Solr/Lucene for searching non-text tables?

I am creating a web application to retrieve subsets of one large (4m rows) table. The 4m rows only change once a year. The table has 200+ columns of types boolean and numeric. It has no text columns. ...
2
votes
1answer
2k views

Privileges needed for Oracle Text

I'm new to Oracle Text and I am using it to support a search feature in an application I have written. The everything seems to be working correctly except I'm not happy with the fact that I had to ...
4
votes
3answers
512 views

Full Text Search With PostgreSQL

i have a table with this rows: Stickers ------------------------------------------------------ ID | Title |Keywords (ts_vector) ------------------------------------------------------ ...
3
votes
2answers
3k views

How to search for a specific column name in all the tables in MySQL Workbench?

In MySQL Workbench, is it possible to search for a specific column name in all the tables? (Writing the string to look for in the field at the top right does nothing). Thank you.
2
votes
0answers
41 views

improving this goal query

Goal joining the two tables: tbl_quickSearchParam (fulltext search results) against tbl_product ( active products : prod_status = 1, group by prod_image_name) create table tbl_product ( ...
1
vote
1answer
2k views

Find fulltext indexes in SQL Server 2008

How do I find a list of tables that have a FULLTEXT INDEX applied to them on a given database? For example, you can enable and disable a FULLTEXT INDEX like this: ALTER FULLTEXT INDEX ON ...
1
vote
1answer
143 views

Parse hyphenated word to unsigned integer

When tested to_tsvector on 'someword-123' with english full text config, I got the following result: SELECT to_tsvector('someword-123'); to_tsvector tsvector -------------------- "'-123':2 ...
1
vote
1answer
972 views

SQL Server Full-Text Indexer with stoplists/stopwords

As I'm working on a graduate project (Textmining with SQL Server 2012 Semantic Search) I run into a situation where I need to post a question on this website, hoping someone can help me. This ...
9
votes
2answers
452 views

SQL Server Filetable document properties

I'm using SQL Server 2012's Filetable to store documents and search them with Semantic Search. I was wondering if there is a way to list all the document properties (meta data). There is a way to ...
2
votes
2answers
93 views

Looking for a database that supports fulltext but does not lock table on insert or update

I have a program that needs to insert and update a table very frequently (200+ insert or update queries per minute), and this table should also support fulltext search. I am currently using MySQL ...
3
votes
0answers
122 views

SQL Server fulltext_semantic_languages

When trying to install a semantic search example, I'm running into a problem. There are some steps in the example to check if the 'new' Semantic Search and Full Text Search are installed. ...
1
vote
1answer
2k views

Full-text search in SQL Server on multiple tables fails

tl;dr version: A full-text search using FREETEXTABLE that worked fine on one column in one table produces 100% false postitives and 100% false negatives when the same steps are followed but the ...
0
votes
1answer
185 views

How to avoid certain characters in MySQL full text search?

I have a column named parcel_number of varchar type. It contains values like ab-cd-ef and uvwxyz. A search for abcdef or uv-wx-yz does not return those records. How should I write the query to meet ...
1
vote
1answer
586 views

Slow insert with MySQL full-text index

I use a full-text index in a MySQL table, and each insert into this table takes about 3 seconds. It seems that MySQL rebuilds (a part) of the full text index after each insert/update. Is this right? ...
3
votes
1answer
186 views

Can underscore be forced as a word splitter without a full-text parser plugin?

Is there any way in MySQL to force underscore to become a word splitter character (like space or dash) without having to use a fulltext parser plugin? If not, does such a plugin already exist or do I ...
3
votes
2answers
332 views

What characters are word breakers in English for SQL Server 2005 and 2008 R2?

I can find what DLL supports English word breakers by using sp_help_fulltext_system_components but I have not been able to find an actual list of the word breaking characters for English (like blank, ...
1
vote
2answers
711 views

Slow mysql fulltext query

I have a little problem with the performance of a mysql-query which uses a fulltext index. The following query SELECT Mention.id FROM mentions AS Mention WHERE (MATCH (`Mention`.`title_text`, ...
0
votes
1answer
102 views

SQL Server 2008 Full-Text Search installation

I have full version of SQL Server 2008 R2 on my machine. Only problem is when my computer was created (by the IT Tech's at my work) they did not add the Full-Text Search feature to the installation. I ...
2
votes
0answers
408 views

SQL fulltext accent insensitive

I am using SQL Server fulltext containstable and the column which is indexed has collation Czech_CS_AS, so why when I have word "byt" it returns records with word "být" too. I thought that the ...
2
votes
1answer
125 views

MySQL full text search result problem

I have this query that does not return any results: SELECT MATCH (e.firstname, e.lastname, e.tc_identity) AGAINST ('Baha') AS Score , e.* FROM employees AS e WHERE MATCH (e.firstname, ...
0
votes
1answer
58 views

Searching through lots of applications

Google search has instant search feature. While you are typing, it finds the pages. Apple.com search box. StackExchange ask question part finds similar questions while you are typing question title. ...
6
votes
1answer
125 views

Can I get the union of the a Postgres fulltext index?

I have a fulltext index on a table. Is it possible to retrieve the set of terms used in the index (gist or gin)? With weights if possible? To clarify: If I have the following table: create table ...
2
votes
1answer
368 views

SQL Server 2005: Full-text search on a multi-lingual table

I have an articles table as follows. +-----------+--------------+---------+ | uid | int | PRIMARY | | articleId | int | UNIQUE | | lang | varchar(2) | UNIQUE | | ...
5
votes
1answer
772 views

Can I have an InnoDB master and MyISAM slaves with Full-Text for searching?

I'd like to use InnoDB on the master, for its transactional ability, but MyISAM on the slaves for the full-text search ability. Is this possible?
3
votes
2answers
475 views

SQL Server 2005: Full-text search space requirements

Is there a way to calculate the physical drive space required for a full-text search catalog? Space is cheap, but I'd like to know what I'm getting into. I'm looking at a table of about 200 articles ...
1
vote
1answer
56 views

SQL Server 2005: Full-text search catalog design

I'm new to full-text searches, and am curious about how to properly design the full-text catalogs. I have an "articles" table. I would like to do full-text search on both the "title" and the "body" ...
2
votes
1answer
802 views

SQL Server 2005: Full-text search, order by matches

Is it possible to do a full-text search in SQL Server 2005, ordering on the number of matches? For example, let's say I have the following products for sale. Tennis Racquets Tennis Balls Footballs ...
0
votes
1answer
160 views

Simple Search on 13 Terabyte Oracle Database to return relevant rows (.net app? Java?)

I am sure there are some easy ways to do this... I have a simple flat Oracle table which is 13 terabytes or so in size due to a large number of rows accumulating over the years. I need to do a search ...
2
votes
1answer
64 views

Full Text search returns duplicate keys

I have a search like the example below. The problem is that the result returns a key muliple times if the term "beach" is in myTextColumn multiple times, for example "I went to the beach because the ...
1
vote
1answer
333 views

How to match on a longer word using MySQL Full Text Search?

I have 2 tables : Company and category (category table has tags field, I wrote keywords for each category, I used comma(,) as delimiter) When I search something, it will first search in the company ...
2
votes
1answer
115 views

why/how does the number of matched columns influences the way of excecuting a query

Imagine the following situation: Table A uses MyISAM and contains 4 fields (text) with a combined FULLTEXT-index. FULLTEXT fulltext1 | fulltext2 | fulltext3 | fulltext4 Table B uses InnoDB and ...
3
votes
1answer
2k views

Why full-text-search returns less rows than LIKE

I don't get full-text-search working as I want it to, and I don't understand the differences in the resultlists. Example statements: SELECT `meldungstext` FROM `artikel` WHERE `meldungstext` LIKE ...
4
votes
2answers
813 views

Slow ORDER BY with LIMIT

I have this query: SELECT * FROM location WHERE to_tsvector('simple',unaccent2("city")) @@ to_tsquery('simple',unaccent2('wroclaw')) order by displaycount I'm happy with it: "Sort ...
0
votes
1answer
56 views

2 Very similar queries return different number of result (one is null)

I want to find businesses near a point that contain a word that start with sea lat=-6.185068&long=106.773121&keyword=sea&distance=5000&startfrom=0&howmany=20&prominent=5 ...
-2
votes
1answer
2k views

Why does MATCH (FullTextSearch) AGAINST ('*' IN BOOLEAN MODE) return nothing?

MATCH (FullTextSearch) AGAINST ('k*' IN BOOLEAN MODE) return something Namely anything with a word that start with k MATCH (FullTextSearch) AGAINST ('ku*' IN BOOLEAN MODE) return less MATCH ...
0
votes
1answer
219 views

Why number of matches in fulltext search get less when we put less strings?

SELECT * FROM tableauxiliary WHERE MATCH (FullTextSearch) AGAINST ('resta*' IN NATURAL LANGUAGE MODE) show 5 results SELECT * FROM tableauxiliary WHERE MATCH (FullTextSearch) AGAINST ('restaurant*' ...
1
vote
1answer
391 views

which database engine is best for full text search on a 10M rows table?

I'm creating a search engine and needs to search keywords in a text field (about 300 words in each text field, unstructured). I'm thinking about noSQL\MySQL+Sphinx, the performance impact here is ...
0
votes
1answer
820 views

Full Text Search not searching special character

I am working on SQL Server 2008. I have created full text index on a Table(Column) and I am trying to find. SELECT * FROM TblName WHERE CONTAINS(ColName,'@#'); This is giving no results. But I ...
0
votes
1answer
85 views

Is there a way to display current noise words in SQL 2000 Full Text Indexing?

I know this is ancient technology, but sometimes upgrading is not always an option. Does anyone now how to list the actual noise words that are currently in use on a SQL 2000 Full Text Index? We ...
25
votes
5answers
4k views

What database technologies do big search engines use?

Does anybody knows how Google or Yahoo perform searches for keywords against very very huge amounts of data? What sort of database or technologies do they employ for this? It takes few milliseconds, ...
3
votes
3answers
2k views

slow query with fulltext and left join

I have 3 tables about 250,000 records. table1 is MyISAM, add fullindex with title and content, add index with pid. table2 and table3 are InnoDB, add index with pid. Only query table3, just cost ...
5
votes
1answer
595 views

MySQL EXPLAIN doesn't show 'use index' for FULLTEXT

I have a basic table : create table fullTextTest ( id INT(11) NOT NULL, superText CHAR(255) NOT NULL, superLongText TEXT NOT NULL, primary key (`id`), FULLTEXT KEY `superText` ...
1
vote
1answer
88 views

What is the use of creating full text catalog in full text indexing

Just want to know about the processes happening in full text indexing. I know by defining the full text indexing for a table, it will index all the words saved in that table. But i didn't get the use ...