| Package | Description | 
|---|---|
| gate.creole.annic.apache.lucene.analysis.standard | A grammar-based tokenizer constructed with JavaCC. | 
| Modifier and Type | Class and Description | 
|---|---|
| class  | FastCharStreamAn efficient implementation of JavaCC's CharStream interface. | 
| Modifier and Type | Field and Description | 
|---|---|
| protected CharStream | StandardTokenizerTokenManager. input_stream | 
| Modifier and Type | Method and Description | 
|---|---|
| void | StandardTokenizer. ReInit(CharStream stream) | 
| void | StandardTokenizerTokenManager. ReInit(CharStream stream) | 
| void | StandardTokenizerTokenManager. ReInit(CharStream stream,
      int lexState) | 
| Constructor and Description | 
|---|
| StandardTokenizer(CharStream stream) | 
| StandardTokenizerTokenManager(CharStream stream) | 
| StandardTokenizerTokenManager(CharStream stream,
                             int lexState) | 
Copyright © 2024 GATE. All rights reserved.