31 Aug 2004
CS 5244: Policy
9
Peer review
limitations
¡Goal
of peer review is to insure:
lPrevious
work adequately acknowledged
lExperimental
methodology realistic and reproducible
lAnalysis
of data justifies conclusions
¡Peters
and Ceci (82):
lResubmitted
12 psychology articles already published with different author names, 8 of 9 recommended against acceptance and were rejected “serious methodological flaw”, not because of déjà vu.
¡Inglefinger
study of NEJM reviewers:
lConcordance
of reviews only slightly better than chance
lReviewers not
skilled in all areas of a study, unable to discern poor writing and have their own biases