Evaluation Metrics
• Mean reciprocal rank (MRR)
– Measure the mean rank position of the correct
answer in the returned rank list
– On the top 20 returned passages
• Percentage of questions with incorrect
answers
• Precision at the top one passage