Uses of Class
org.apache.lucene.analysis.cn.smart.hhmm.SegToken
-
Packages that use SegToken Package Description org.apache.lucene.analysis.cn.smart Analyzer for Simplified Chinese, which indexes words.org.apache.lucene.analysis.cn.smart.hhmm SmartChineseAnalyzer Hidden Markov Model package. -
-
Uses of SegToken in org.apache.lucene.analysis.cn.smart
Fields in org.apache.lucene.analysis.cn.smart with type parameters of type SegToken Modifier and Type Field Description private java.util.Iterator<SegToken>
HMMChineseTokenizer. tokens
Methods in org.apache.lucene.analysis.cn.smart that return SegToken Modifier and Type Method Description SegToken
WordSegmenter. convertSegToken(SegToken st, java.lang.String sentence, int sentenceStartOffset)
Process aSegToken
so that it is ready for indexing.Methods in org.apache.lucene.analysis.cn.smart that return types with arguments of type SegToken Modifier and Type Method Description java.util.List<SegToken>
WordSegmenter. segmentSentence(java.lang.String sentence, int startOffset)
Segment a sentence into words withHHMMSegmenter
Methods in org.apache.lucene.analysis.cn.smart with parameters of type SegToken Modifier and Type Method Description SegToken
WordSegmenter. convertSegToken(SegToken st, java.lang.String sentence, int sentenceStartOffset)
Process aSegToken
so that it is ready for indexing. -
Uses of SegToken in org.apache.lucene.analysis.cn.smart.hhmm
Fields in org.apache.lucene.analysis.cn.smart.hhmm with type parameters of type SegToken Modifier and Type Field Description private java.util.List<SegToken>
BiSegGraph. segTokenList
private java.util.Map<java.lang.Integer,java.util.ArrayList<SegToken>>
SegGraph. tokenListTable
Map of start offsets to ArrayList of tokens at that positionMethods in org.apache.lucene.analysis.cn.smart.hhmm that return SegToken Modifier and Type Method Description SegToken
SegTokenFilter. filter(SegToken token)
Filter an inputSegToken
Methods in org.apache.lucene.analysis.cn.smart.hhmm that return types with arguments of type SegToken Modifier and Type Method Description java.util.List<SegToken>
BiSegGraph. getShortPath()
Find the shortest path with the Viterbi algorithm.java.util.List<SegToken>
SegGraph. getStartList(int s)
Get the list of tokens at the specified start offsetjava.util.List<SegToken>
SegGraph. makeIndex()
Set theindex
for each token, based upon its order by startOffset.java.util.List<SegToken>
HHMMSegmenter. process(java.lang.String sentence)
Return a list ofSegToken
representing the best segmentation of a sentencejava.util.List<SegToken>
SegGraph. toTokenList()
Return aList
of all tokens in the map, ordered by startOffset.Methods in org.apache.lucene.analysis.cn.smart.hhmm with parameters of type SegToken Modifier and Type Method Description void
SegGraph. addToken(SegToken token)
Add aSegToken
to the mapping, creating a new mapping at the token's startOffset if one does not exist.SegToken
SegTokenFilter. filter(SegToken token)
Filter an inputSegToken
-