public final class StopAnalyzer extends StopwordAnalyzerBase
LetterTokenizer
with LowerCaseFilter
and StopFilter
.
You must specify the required Version
compatibility when creating StopAnalyzer:
ReusableAnalyzerBase.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static java.util.Set<?> |
ENGLISH_STOP_WORDS_SET
An unmodifiable set containing some common English words that are not usually useful
for searching.
|
matchVersion, stopwords
Constructor and Description |
---|
StopAnalyzer(Version matchVersion)
Builds an analyzer which removes words in
ENGLISH_STOP_WORDS_SET . |
StopAnalyzer(Version matchVersion,
java.io.File stopwordsFile)
Builds an analyzer with the stop words from the given file.
|
StopAnalyzer(Version matchVersion,
java.io.Reader stopwords)
Builds an analyzer with the stop words from the given reader.
|
StopAnalyzer(Version matchVersion,
java.util.Set<?> stopWords)
Builds an analyzer with the stop words from the given set.
|
Modifier and Type | Method and Description |
---|---|
protected ReusableAnalyzerBase.TokenStreamComponents |
createComponents(java.lang.String fieldName,
java.io.Reader reader)
Creates
ReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the provided Reader . |
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
initReader, reusableTokenStream, tokenStream
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setPreviousTokenStream
public static final java.util.Set<?> ENGLISH_STOP_WORDS_SET
public StopAnalyzer(Version matchVersion)
ENGLISH_STOP_WORDS_SET
.matchVersion
- See abovepublic StopAnalyzer(Version matchVersion, java.util.Set<?> stopWords)
matchVersion
- See abovestopWords
- Set of stop wordspublic StopAnalyzer(Version matchVersion, java.io.File stopwordsFile) throws java.io.IOException
matchVersion
- See abovestopwordsFile
- File to load stop words fromjava.io.IOException
WordlistLoader.getWordSet(Reader, Version)
public StopAnalyzer(Version matchVersion, java.io.Reader stopwords) throws java.io.IOException
matchVersion
- See abovestopwords
- Reader to load stop words fromjava.io.IOException
WordlistLoader.getWordSet(Reader, Version)
protected ReusableAnalyzerBase.TokenStreamComponents createComponents(java.lang.String fieldName, java.io.Reader reader)
ReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the provided Reader
.createComponents
in class ReusableAnalyzerBase
fieldName
- the name of the fields content passed to the
ReusableAnalyzerBase.TokenStreamComponents
sink as a readerreader
- the reader passed to the Tokenizer
constructorReusableAnalyzerBase.TokenStreamComponents
built from a LowerCaseTokenizer
filtered with
StopFilter
Copyright © 2000-2018 Apache Software Foundation. All Rights Reserved.