geekhack

Site Announcements and Feedback => Announcements/Feedback/Suggestions => Topic started by: rknize on Wed, 10 July 2013, 14:32:33

Title: New Search Engine
Post by: rknize on Wed, 10 July 2013, 14:32:33

GeekHack is far too large for SMF's normal search indexer to cope with.  This problem has been on my back burner for a while.  We now have Sphinx up and running, which is not only much faster but should produce results with greater quality.  For example, you can use search terms with less than 3 characters.

Let me know if there are any issues.

Title: Re: New Search Engine
Post by: SpAmRaY on Wed, 10 July 2013, 14:33:32

Woot!! This is so awesome....now to try it out.... ;)

Title: Re: New Search Engine
Post by: Tym on Wed, 10 July 2013, 14:38:38

Thank Christ, good work lads, thank you!

Title: Re: New Search Engine
Post by: rowdy on Wed, 10 July 2013, 15:13:31

Assuming it is accessed from the search field in the upper right corner of the main page, I searched for "model m keycaps" (without quotes) and got this error:

Each word must be at least two characters long.

Title: Re: New Search Engine
Post by: alaricljs on Wed, 10 July 2013, 15:15:02

well, 2 is less than 3  :)

Title: Re: New Search Engine
Post by: rowdy on Wed, 10 July 2013, 17:19:27

1 is also less than three ;)

Title: Re: New Search Engine
Post by: CommunistWitchDr on Wed, 10 July 2013, 17:30:36

Quote from: rowdy on Wed, 10 July 2013, 17:19:27

1 is also less than three ;)

Now searching for all posts containing phrases "a" or "e" or "i" or "o" or "u".

Title: Re: New Search Engine
Post by: rowdy on Wed, 10 July 2013, 17:35:28

Ok, so I searched for: "model m" keycaps

(quotes around "model m", no quote around keycaps, thinking that it might search for posts containing those two phrases, but ...

(http://i.imgur.com/Wmu4hjs.png)

Title: Re: New Search Engine
Post by: alaricljs on Wed, 10 July 2013, 19:25:33

You tricked it!

Title: Re: New Search Engine
Post by: mkawa on Wed, 10 July 2013, 23:44:59

in theory, the query "model m" AND keycaps should work.

the query language documentation is here: http://sphinxsearch.com/docs/current.html#searching

however, to get this working, rknize had to rip out the smf search engine and glue in the sphinx backend, so consider this still to be a beta feature. however, the changeover to sphinx has been planned for a long time (a year, basically), so this is not in any way experimental. report bugs to the massive bug report thread (rknize has a possible method for that madness in the works as well, by the way).

Title: Re: New Search Engine
Post by: rknize on Thu, 11 July 2013, 00:25:23

I have it setup for extended syntax:

http://sphinxsearch.com/docs/current.html#extended-syntax

It seems like the phrase operator (quotes) don't work as expected.  I'll look into this.  Perhaps SMF is stripping the quotes.

Title: Re: New Search Engine
Post by: Glod on Thu, 11 July 2013, 17:30:23

Hmmm the syntax is similar to a combination of Concordance, dtSearch, and Lucene if anyone has worked in the legal industry like i do.

Title: Re: New Search Engine
Post by: hashbaz on Thu, 11 July 2013, 17:42:21

regex plz