User Tools

Site Tools


components:crawler_plugins
Translations of this page:

**This is an old revision of the document!** ----

A PCRE internal error occured. This might be caused by a faulty plugin

====== Crawler Plugins ====== Crawler Plugins hook into the [[project_info:crawling_process|crawling process]] in order to add advanced functionality. ==== What can crawler plugins do? ==== Some examples: * Modify the result of preparators * by specifying default-values if the chosen preparator does not fill in a certain field (''onBeforePrepare'') * by overriding or modyfing the results of whatever preparator was chosen (''onAfterPrepare'') * Modify their storage in the lucene index * Do sth at every start or end of the crawling process (e.g. inform the administrator via email) ==== How to create a crawler plugin ==== - Create a class that implements ''CrawlerPlugin''. - Packaged it (and all its dependencies) as a .jar * In the manifest file, the attribute ''Plugin-Class'' must be set to the complete class name of the implementing class. - Drop it into the ''plugins''-Directory. ==== Crawler Plugin API ==== === onStartCrawling === ''void onStartCrawling(Crawler crawler)'' Called before the crawling process starts (Crawler::run()). This may be called multiple times during the lifetime of a plugin instance, but onFinishCrawling() is always called in between. **Parameters**: crawler The crawler instance that is about to begin crawling === onFinishCrawling === ==== Existing Plugins ==== * Create Thumbnails of indexed documents: https://github.com/benjamin4ruby/java-thumbnailer

components/crawler_plugins.1312016259.txt.gz · Last modified: 2024/09/18 08:31 (external edit)