August 17, 2005
Question Answering Passage Retrieval Using Dependency Parsing
25/28
Performance on Top of Query Expansion
•On top of query expansion, fuzzy relation matching brings a further 50% improvement
•However
–query expansion doesn’t help much on a fuzzy relation matching system
–Expansion terms do not help in paring relation paths
0.4074
0.4074
0.2315
0.1759
Precision at top one passage
22.22%
22.22%
28.40%
33.02%
% Incorrect
+49.86%
+49.54%
N/A
N/A
% MRR improvement over NUS+QE
0.4935
(+84.35%)
0.4924
(+83.94%)
0.3293
(+23.00%)
0.2677
MRR
(% improvement over baseline)
Rel_EM (NUS+QE)
Rel_MI (NUS+QE)
NUS+QE
NUS
(baseline)
Passage Retrieval Systems
Rel_EM (NUS)
0.4761