Photo by livingOS

Practical Natural Language Processing (with Min-Yen KAN, Group leader of the Web IR / NLP Group @ National University of Singapore)

Menu

[ >Overview ]

This is a three day course focusing on practical natural language processing. It was most recently taught in October 2008.

• Day 1 - Natural Language Processing Overview
  AM: Introduction to NLP, NLP Application Whirlwind
  PM: Hands-on with NLTK - building an information extraction system
  [ Day 1 Slides (AM) ] [ Day 1 Slides (PM) ] [ Source Code for Day 1 ]

• Day 2 - Classification, Information Retrieval and Machine Learning
  Evaluation, Annotation, Information Retrieval, NLP as a machine learning problem
  Hands-on with SVM^light - building a text classification system
  [ Day 2 Slides (AM) ] [ Day 2 Slides (PM) ] [ Source Code for Day 2 ]

• Day 3 - Wrapping up and Trends
  Sequence Labeling, Dimensionality Reduction, Document Clustering and Trends
  Hands-on with CRF++ - building a citation labeler
  [ Day 3 Slides (AM) ] [ Day 3 Slides (PM) ] [ Source Code for Day 3 ]

Toolkits Used

• NLTK - Python based Natural Language Toolkit. Source code is GPL'ed, documentation is Creative Commons Non-commercial use. Ok to teach from this source (checked with authors). Requires python.
  [ Main site ] [ Local version (UNIX, v0.9.5) ] [ Local NLTK Data (v0.9.5) ] [ Local NLTK Book Draft ]
• SVM^light - The classic support vector machine package. Free for academic or research use. Licensable from the author.
  [ Main site ] [ No local version permitted by author ]
• CRF++ - Conditional Random Fields implementation in C++. Fast, and LGPL'ed. You can try out the author's SVM implementation as well (TinySVM). Conlleval.pl evaluation script requires perl.
  [ Main site ] [ Local copy of v0.51 tgz ] [ CoNLLeval.pl perl script ]

Textbooks Used

• J&M - Jurafsky and Martin (2000) Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition.
• MRS - Manning, Raghavan, Schütze (2008) Introduction to Information Retrieval.
  Whole book currently at: http://www-csli.stanford.edu/~hinrich/information-retrieval-book.html

---

This document, index.html, has been accessed 12009 times since 12-Oct-08 21:26:30 SGT. This is the 1st time it has been accessed today. A total of 4772 different hosts have accessed this document in the last 5670 days; your host, ec2-18-191-239-123.us-east-2.compute.amazonaws.com, has accessed it 1 times.

Min-Yen Kan <kanmy@comp.nus.edu.sg> Sun Jul 13 00:15:27 SGT 2008 | Version: 1.0 | Last modified: Thu Oct 16 18:01:28 2008