Package | Description |
---|---|
gate.creole.annic.apache.lucene.analysis.standard |
A grammar-based tokenizer constructed with JavaCC.
|
Modifier and Type | Class and Description |
---|---|
class |
FastCharStream
An efficient implementation of JavaCC's CharStream interface.
|
Modifier and Type | Field and Description |
---|---|
protected CharStream |
StandardTokenizerTokenManager.input_stream |
Modifier and Type | Method and Description |
---|---|
void |
StandardTokenizer.ReInit(CharStream stream) |
void |
StandardTokenizerTokenManager.ReInit(CharStream stream) |
void |
StandardTokenizerTokenManager.ReInit(CharStream stream,
int lexState) |
Constructor and Description |
---|
StandardTokenizer(CharStream stream) |
StandardTokenizerTokenManager(CharStream stream) |
StandardTokenizerTokenManager(CharStream stream,
int lexState) |
Copyright © 2024 GATE. All rights reserved.