Uses of Interface
sg.edu.nus.comp.nlp.ims.util.ITokenizer

Packages that use ITokenizer
sg.edu.nus.comp.nlp.ims.corpus Package related to the training or test corpus. 
sg.edu.nus.comp.nlp.ims.util Package related to utility data structures, algorithms and some external API used by multiple other packages. 
 

Uses of ITokenizer in sg.edu.nus.comp.nlp.ims.corpus
 

Fields in sg.edu.nus.comp.nlp.ims.corpus declared as ITokenizer
protected  ITokenizer ACorpus.m_Tokenizer
           
 

Constructors in sg.edu.nus.comp.nlp.ims.corpus with parameters of type ITokenizer
ACorpus(IPOSTagger p_POSTagger, ISentenceSplitter p_Splitter, ITokenizer p_Tokenizer, ILemmatizer p_Lemmatizer)
          constructor with some components
CAllWordsCoarseTaskCorpus(IPOSTagger p_POSTagger, ISentenceSplitter p_Splitter, ITokenizer p_Tokenizer, ILemmatizer p_Lemmatizer)
          constructor with some components
CAllWordsFineTaskCorpus(IPOSTagger p_POSTagger, ISentenceSplitter p_Splitter, ITokenizer p_Tokenizer, ILemmatizer p_Lemmatizer)
          constructor with some components
CAllWordsPlainCorpus(IPOSTagger p_POSTagger, ISentenceSplitter p_Splitter, ITokenizer p_Tokenizer, ILemmatizer p_Lemmatizer)
          constructor with some components
CLexicalCorpus(IPOSTagger p_POSTagger, ISentenceSplitter p_Splitter, ITokenizer p_Tokenizer, ILemmatizer p_Lemmatizer)
          constructor with some components
 

Uses of ITokenizer in sg.edu.nus.comp.nlp.ims.util
 

Classes in sg.edu.nus.comp.nlp.ims.util that implement ITokenizer
 class COpenNLPTokenizer
          opennlp tokenizer.
 class CPennTreeBankTokenizer
          Penn Treebank tokenizer.