Strigi

Strigi Desktop Search

Here are the main features of Strigi:
very fast crawling
very small memory footprint
no hammering of the system
pluggable backend, currently clucene and hyperestraier, sqlite3 and xapian are in the works
communication between daemon and search program over an abstract interface with two implementations: DBus and a simple unix socket. Especially the DBus interface makes it very easy to write client applications. There are a few sample scripts in the code using Perl, Python, GTK and Qt. Writing clients is so easy that any Gnome or KDE app could implement this.
Aditionally, there is a simple interface for implementing plugins for extracting information. We'll try to reuse the kat plugins, although native plugins will have a large speed advantage.
Strigi also has calculation of sha1 for every file crawled which allows for fast finding of duplicate files.

0.6.4
- Path fixes to the build system the benefit of windows users (sengels)
- Clean up of class ArchiveReader
- Support for LZMA compressed streams in archives, notably .deb and .rpm
- Remove preceding ./ from file path in tar archives.
- Make parsing ar and deb files easier to abort: useful in e.g. Dolphin
- Better method of removing deleted file from the CLucene
- Do not tokenize the URL in the index to improve polling speed
- Fix the bz2 header check: more bz2 archives are recognized (pino)
- Fix infinite loop on parsing SGI image files
- Fix reading of zip files without central directory.