August 17, 2005
Question Answering Passage Retrieval Using Dependency Parsing
21/28
Evaluation Metrics
•Mean reciprocal rank (MRR)
–Measure the mean rank position of the correct answer in the returned rank list
–On the top 20 returned passages
•Percentage of questions with incorrect answers
•Precision at the top one passage