public class AlphabeticTokenizer extends Tokenizer
Modifier and Type | Field and Description |
---|---|
protected int |
m_CurrentPos
the current position
|
protected char[] |
m_Str
the characters of the string
|
Constructor and Description |
---|
AlphabeticTokenizer() |
Modifier and Type | Method and Description |
---|---|
String |
getRevision()
Returns the revision string.
|
String |
globalInfo()
Returns a string describing the stemmer
|
boolean |
hasMoreElements()
returns whether there are more elements still
|
static void |
main(String[] args)
Runs the tokenizer with the given options and strings to tokenize.
|
Object |
nextElement()
returns the next element
|
void |
tokenize(String s)
Sets the string to tokenize.
|
getOptions, listOptions, runTokenizer, setOptions, tokenize
protected char[] m_Str
protected int m_CurrentPos
public String globalInfo()
globalInfo
in class Tokenizer
public boolean hasMoreElements()
hasMoreElements
in interface Enumeration
hasMoreElements
in class Tokenizer
public Object nextElement()
nextElement
in interface Enumeration
nextElement
in class Tokenizer
public void tokenize(String s)
public String getRevision()
public static void main(String[] args)
args
- the commandline options and strings to tokenizeCopyright © 2015 University of Waikato, Hamilton, NZ. All rights reserved.