|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectsg.edu.nus.comp.nlp.ims.util.COpenNLPTokenizer
public final class COpenNLPTokenizer
opennlp tokenizer.
Constructor Summary | |
---|---|
COpenNLPTokenizer()
constructor |
|
COpenNLPTokenizer(opennlp.maxent.MaxentModel p_Model)
constructor |
|
COpenNLPTokenizer(java.lang.String p_FileName)
constructor |
Method Summary | |
---|---|
static void |
setModel(opennlp.maxent.MaxentModel p_Model)
set default tokenization model |
java.lang.String[] |
tokenize(java.lang.String p_Sentence)
tokenize an input sentence into tokens |
static java.lang.String[] |
tokenizeWithDefault(java.lang.String p_Sentence)
tokenize with default model |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public COpenNLPTokenizer()
public COpenNLPTokenizer(opennlp.maxent.MaxentModel p_Model)
p_Model
- modelpublic COpenNLPTokenizer(java.lang.String p_FileName) throws java.io.IOException
p_FileName
- model file
java.io.IOException
- exception while reading modelMethod Detail |
---|
public static void setModel(opennlp.maxent.MaxentModel p_Model)
p_Model
- modelpublic java.lang.String[] tokenize(java.lang.String p_Sentence)
ITokenizer
tokenize
in interface ITokenizer
p_Sentence
- input sentence
public static java.lang.String[] tokenizeWithDefault(java.lang.String p_Sentence)
p_Sentence
- input sentence
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |