Package gate.creole.annic.apache.lucene.analysis.standard

A grammar-based tokenizer constructed with JavaCC.

See: Description

Interface Summary

Interface	Description
CharStream	This interface describes a character stream that maintains line and column number positions of the characters.
StandardTokenizerConstants

Class Summary

Class	Description
FastCharStream	An efficient implementation of JavaCC's CharStream interface.
StandardTokenizer	A grammar-based tokenizer constructed with JavaCC.
StandardTokenizerTokenManager
Token	Describes the input token stream.

Exception Summary

Exception	Description
ParseException	This exception is thrown when parse errors are encountered.

Error Summary

Error	Description
TokenMgrError

Package gate.creole.annic.apache.lucene.analysis.standard Description

A grammar-based tokenizer constructed with JavaCC.

Note that JavaCC defines lots of public classes, methods and fields that do not need to be public. These clutter the documentation. Sorry.

Note that because JavaCC defines a class named Token, org.apache.lucene.analysis.Token must always be fully qualified in source code in this package.