|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use ITokenizer | |
---|---|
sg.edu.nus.comp.nlp.ims.corpus | Package related to the training or test corpus. |
sg.edu.nus.comp.nlp.ims.util | Package related to utility data structures, algorithms and some external API used by multiple other packages. |
Uses of ITokenizer in sg.edu.nus.comp.nlp.ims.corpus |
---|
Fields in sg.edu.nus.comp.nlp.ims.corpus declared as ITokenizer | |
---|---|
protected ITokenizer |
ACorpus.m_Tokenizer
|
Constructors in sg.edu.nus.comp.nlp.ims.corpus with parameters of type ITokenizer | |
---|---|
ACorpus(IPOSTagger p_POSTagger,
ISentenceSplitter p_Splitter,
ITokenizer p_Tokenizer,
ILemmatizer p_Lemmatizer)
constructor with some components |
|
CAllWordsCoarseTaskCorpus(IPOSTagger p_POSTagger,
ISentenceSplitter p_Splitter,
ITokenizer p_Tokenizer,
ILemmatizer p_Lemmatizer)
constructor with some components |
|
CAllWordsFineTaskCorpus(IPOSTagger p_POSTagger,
ISentenceSplitter p_Splitter,
ITokenizer p_Tokenizer,
ILemmatizer p_Lemmatizer)
constructor with some components |
|
CAllWordsPlainCorpus(IPOSTagger p_POSTagger,
ISentenceSplitter p_Splitter,
ITokenizer p_Tokenizer,
ILemmatizer p_Lemmatizer)
constructor with some components |
|
CLexicalCorpus(IPOSTagger p_POSTagger,
ISentenceSplitter p_Splitter,
ITokenizer p_Tokenizer,
ILemmatizer p_Lemmatizer)
constructor with some components |
Uses of ITokenizer in sg.edu.nus.comp.nlp.ims.util |
---|
Classes in sg.edu.nus.comp.nlp.ims.util that implement ITokenizer | |
---|---|
class |
COpenNLPTokenizer
opennlp tokenizer. |
class |
CPennTreeBankTokenizer
Penn Treebank tokenizer. |
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |