gate.creole.annic.lucene

Class LuceneTokenizer

java.lang.Object

gate.creole.annic.apache.lucene.analysis.TokenStream

gate.creole.annic.lucene.LuceneTokenizer

public class LuceneTokenizer
extends TokenStream

Implementation of token stream.

Author:

niraj

Constructor Summary

Constructors

Constructor and Description
LuceneTokenizer(List<Token> tokenStream) Constructor

Method Summary

Modifier and Type	Method and Description
Token	next() Returns the next token in the token stream.

Methods inherited from class gate.creole.annic.apache.lucene.analysis.TokenStream

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LuceneTokenizer

public LuceneTokenizer(List<Token> tokenStream)

Constructor

Parameters:

tokenStream -

Method Detail

next

public Token next()
           throws IOException

Returns the next token in the token stream.

Specified by:

next in class TokenStream

Throws:

IOException