Package gate.creole.annic.apache.lucene.analysis

API and code to convert text into indexable tokens.

See: Description

Class Summary

Class	Description
Analyzer	An Analyzer builds TokenStreams, which analyze text.
Token
Tokenizer	A Tokenizer is a TokenStream whose input is a Reader.
TokenStream	A TokenStream enumerates the sequence of tokens, either from fields of a document or from query text.

Package gate.creole.annic.apache.lucene.analysis Description

API and code to convert text into indexable tokens.