19 Oct 2004
CS 5244: Library Evaluation
28
Factoring in size of a corpus
¡
Look at how P/R or Sn/Sp varies
as a function of rank:
¡
¡
Choose a number of different
ranks and calculate P/R or
Sn/Sp
l
Correspond to vertical lines on
graphs at right
l
Plot Sn vs. 1-Sp to get points for
ROC curve.
Interpolate curve.
l
Irrelevant
Relevant
Rank
n
1
Relevant
Irrelevant
Which of these examples is
which from the previous slide?