Uses of Interface
org.apache.commons.text.similarity.Tokenizer
Packages that use Tokenizer
-
Uses of Tokenizer in org.apache.commons.text.similarity
Classes in org.apache.commons.text.similarity that implement TokenizerModifier and TypeClassDescription(package private) class
A simple word tokenizer that utilizes regex to find words.Fields in org.apache.commons.text.similarity declared as TokenizerModifier and TypeFieldDescriptionprivate final Tokenizer<CharSequence>
CosineDistance.tokenizer
Tokenizer used to convert the character sequence into a vector.