4 Aug 2003
CS 6210: Module 0
32/38
How to read a paper - depth
¡Examine the statistics:
“Lies, d*mned lies and statistics”
“Lies, d*mned lies and statistics”
lAppropriate statistical tests applied properly?
lDid they do proper error analysis?
lAre the results statistically significant?
¡Common mistake: “We performed our experiment once at 4 am and noticed a ten fold improvement. Thus we conclude that our system is better”
lBe very careful with percentages
¡Method A: 0.01 seconds, our Method: 0.005 seconds
¡Our method shows 100% improvement over method A!!