public class IndexWriter extends Object
Modifier and Type | Field and Description |
---|---|
static String |
COMMIT_LOCK_NAME |
static long |
COMMIT_LOCK_TIMEOUT
Default value is 10000.
|
static int |
DEFAULT_MAX_FIELD_LENGTH
Default value is 10000.
|
static int |
DEFAULT_MAX_MERGE_DOCS
Default value is
Integer.MAX_VALUE . |
static int |
DEFAULT_MERGE_FACTOR
Default value is 10.
|
static int |
DEFAULT_MIN_MERGE_DOCS
Default value is 10.
|
PrintStream |
infoStream
If non-null, information about merges will be printed to this.
|
int |
maxFieldLength
The maximum number of terms that will be indexed for a single field in a
document.
|
int |
maxMergeDocs
Determines the largest number of documents ever merged by addDocument().
|
int |
mergeFactor
Determines how often segment indices are merged by addDocument().
|
int |
minMergeDocs
Determines the minimal number of documents required before the buffered
in-memory documents are merging and a new Segment is created.
|
static String |
WRITE_LOCK_NAME |
static long |
WRITE_LOCK_TIMEOUT
Default value is 1000.
|
Constructor and Description |
---|
IndexWriter(Directory d,
Analyzer a,
boolean create)
Constructs an IndexWriter for the index in
d . |
IndexWriter(File path,
Analyzer a,
boolean create)
Constructs an IndexWriter for the index in
path . |
IndexWriter(String path,
Analyzer a,
boolean create)
Constructs an IndexWriter for the index in
path . |
Modifier and Type | Method and Description |
---|---|
void |
addDocument(Document doc)
Adds a document to this index.
|
void |
addDocument(Document doc,
Analyzer analyzer)
Adds a document to this index, using the provided analyzer instead of the
value of
getAnalyzer() . |
void |
addIndexes(Directory[] dirs)
Merges all segments from an array of indexes into this index.
|
void |
addIndexes(IndexReader[] readers)
Merges the provided indexes into this index.
|
void |
close()
Flushes all changes to an index and closes all associated files.
|
int |
docCount()
Returns the number of documents currently in this index.
|
protected void |
finalize()
Release the write lock, if needed.
|
Analyzer |
getAnalyzer()
Returns the analyzer used by this index.
|
Similarity |
getSimilarity()
Expert: Return the Similarity implementation used by this IndexWriter.
|
boolean |
getUseCompoundFile()
Setting to turn on usage of a compound file.
|
void |
optimize()
Merges all segments together into a single segment, optimizing an index
for search.
|
void |
setSimilarity(Similarity similarity)
Expert: Set the Similarity implementation used by this IndexWriter.
|
void |
setUseCompoundFile(boolean value)
Setting to turn on usage of a compound file.
|
public static final long WRITE_LOCK_TIMEOUT
gate.creole.annic.apache.lucene.writeLockTimeout
system property to override.public static final long COMMIT_LOCK_TIMEOUT
gate.creole.annic.apache.lucene.commitLockTimeout
system property to override.public static final String WRITE_LOCK_NAME
public static final String COMMIT_LOCK_NAME
public static final int DEFAULT_MERGE_FACTOR
gate.creole.annic.apache.lucene.mergeFactor
system property to override.public static final int DEFAULT_MIN_MERGE_DOCS
gate.creole.annic.apache.lucene.minMergeDocs
system property to override.public static final int DEFAULT_MAX_MERGE_DOCS
Integer.MAX_VALUE
.
Use gate.creole.annic.apache.lucene.maxMergeDocs
system property to override.public static final int DEFAULT_MAX_FIELD_LENGTH
gate.creole.annic.apache.lucene.maxFieldLength
system property to override.public int maxFieldLength
The maximum number of terms that will be indexed for a single field in a document. This limits the amount of memory required for indexing, so that collections with very large files will not crash the indexing process by running out of memory.
Note that this effectively truncates large documents, excluding from the index terms that occur further in the document. If you know your source documents are large, be sure to set this value high enough to accomodate the expected size. If you set it to Integer.MAX_VALUE, then the only limit is your memory, but you should anticipate an OutOfMemoryError.
By default, no more than 10,000 terms will be indexed for a field.public int mergeFactor
This must never be less than 2. The default value is 10.
public int minMergeDocs
RAMDirectory
,
large value gives faster indexing. At the same time, mergeFactor limits
the number of files open in a FSDirectory.
The default value is 10.
public int maxMergeDocs
The default value is Integer.MAX_VALUE
.
public PrintStream infoStream
public IndexWriter(String path, Analyzer a, boolean create) throws IOException
path
.
Text will be analyzed with a
. If create
is true, then a new, empty index will be created in
path
, replacing the index already there, if any.path
- the path to the index directorya
- the analyzer to usecreate
- true
to create the index or overwrite
the existing one; false
to append to the existing
indexIOException
- if the directory cannot be read/written to, or
if it does not exist, and create
is
false
public IndexWriter(File path, Analyzer a, boolean create) throws IOException
path
.
Text will be analyzed with a
. If create
is true, then a new, empty index will be created in
path
, replacing the index already there, if any.path
- the path to the index directorya
- the analyzer to usecreate
- true
to create the index or overwrite
the existing one; false
to append to the existing
indexIOException
- if the directory cannot be read/written to, or
if it does not exist, and create
is
false
public IndexWriter(Directory d, Analyzer a, boolean create) throws IOException
d
.
Text will be analyzed with a
. If create
is true, then a new, empty index will be created in
d
, replacing the index already there, if any.d
- the index directorya
- the analyzer to usecreate
- true
to create the index or overwrite
the existing one; false
to append to the existing
indexIOException
- if the directory cannot be read/written to, or
if it does not exist, and create
is
false
public boolean getUseCompoundFile()
public void setUseCompoundFile(boolean value)
public void setSimilarity(Similarity similarity)
Similarity.setDefault(Similarity)
public Similarity getSimilarity()
This defaults to the current value of Similarity.getDefault()
.
public void close() throws IOException
IOException
protected void finalize() throws IOException
finalize
in class Object
IOException
public Analyzer getAnalyzer()
public int docCount()
public void addDocument(Document doc) throws IOException
maxFieldLength
terms for a given field, the remainder are
discarded.IOException
public void addDocument(Document doc, Analyzer analyzer) throws IOException
getAnalyzer()
. If the document contains more than
maxFieldLength
terms for a given field, the remainder are
discarded.IOException
public void optimize() throws IOException
IOException
public void addIndexes(Directory[] dirs) throws IOException
This may be used to parallelize batch indexing. A large document collection can be broken into sub-collections. Each sub-collection can be indexed in parallel, on a different thread, process or machine. The complete index can then be created by merging sub-collection indexes with this method.
After this completes, the index is optimized.
IOException
public void addIndexes(IndexReader[] readers) throws IOException
After this completes, the index is optimized.
The provided IndexReaders are not closed.
IOException
Copyright © 2024 GATE. All rights reserved.