Package | Description |
---|---|
gate.creole.annic.apache.lucene.analysis |
API and code to convert text into indexable tokens.
|
gate.creole.annic.apache.lucene.analysis.standard |
A grammar-based tokenizer constructed with JavaCC.
|
gate.creole.annic.lucene |
Modifier and Type | Method and Description |
---|---|
abstract Token |
TokenStream.next()
Returns the next token in the stream, or null at EOS.
|
Modifier and Type | Method and Description |
---|---|
Token |
StandardTokenizer.next()
Returns the next token in the stream, or null at EOS.
|
Modifier and Type | Method and Description |
---|---|
Token |
LuceneTokenizer.next()
Returns the next token in the token stream.
|
Modifier and Type | Method and Description |
---|---|
List<Token> |
LuceneReader.getTokenStream()
Gets the token stream associated with this reader
|
Modifier and Type | Method and Description |
---|---|
int |
PatternValidator.validate(List<String> queryTokens,
List<Token> annotations,
int from,
QueryParser queryParser)
This method takes two parameters the actual query issued and
annotations in which it checks if the annotations exist that are
validating for the given query
|
Constructor and Description |
---|
LuceneReader(Document gateDoc,
List<Token> tokenStream)
Constructor
|
LuceneTokenizer(List<Token> tokenStream)
Constructor
|
Copyright © 2024 GATE. All rights reserved.