Re: General search problem - challenge - Mailing list pgsql-general

From Richard Huxton
Subject Re: General search problem - challenge
Date
Msg-id 468A0F79.90900@archonet.com
Whole thread Raw
In response to General search problem - challenge  ("Postgres User" <postgres.developer@gmail.com>)
List pgsql-general
Postgres User wrote:
> I have a table of around 6,000 places in the world.  Everytime my
> server receives a ping, I'm grabbing the content of an article from an
> RSS feed.  Then I search the article for the presence of any the 6000
> terms.
> A typical article is around 1200 words.
>
> I don't need to save the article in a table and the search is
> performed only once, so it's not about FTS.
>
> Any thoughts on the best way to execute these searches using a
> traditional language like C++ ?

Not sure that it's got anything to do with PostgreSQL.

1. Pre-process the 6000 words into a hash-lookup-table using hash
library of choice.

2. Split the article into "words" (however you define that)
3. Use your hash table to lookup each word from the article.
4. Stop on first match

Like Steve Atkins says, I'd use Perl instead of C++ and go home early :-)

--
   Richard Huxton
   Archonet Ltd

pgsql-general by date:

Previous
From: Dimitri Fontaine
Date:
Subject: Re: How-To: Aggregate data from multiple rows into a delimited list.
Next
From: "Pavel Stehule"
Date:
Subject: Re: How-To: Aggregate data from multiple rows into a delimited list.