Participation in Benchmarking Evaluations

Over the years, my research team has participated in various international benchmarking evaluations, with the following achievements:

First in coarse-grained English all-words task (out of 14 systems), and second in fine-grained English all-words task (out of 13 systems) in SemEval 2007, organized by ACL SIGLEX, 2007.

First on 3 test corpora, second on the 4th test corpus (out of 18 teams) in the open track of the Second International Chinese Word Segmentation Bakeoff, organized by ACL SIGHAN, 2005.

Third among 47 systems in the English lexical sample task, Senseval-3, organized by ACL SIGLEX, 2004.

First among 8 systems in the translation subtask, first among 6 systems in the translation and sense subtask, of the multilingual lexical sample task, Senseval-3, organized by ACL SIGLEX, 2004.

Top 2 scores (among 6 groups submitting 11 runs) in the routing subtask of the filtering track, TREC-8, 1999.