Peer review limitations
¡ Goal of peer review is to insure:
l Previous work adequately acknowledged
l Experimental methodology realistic and reproducible
l Analysis of data justifies conclusions
¡ Peters and Ceci (82):
l Resubmitted 12 psychology articles already published with
different author names, 8 of 9 recommended against
acceptance and were rejected “serious methodological
flaw”, not because of déjà vu.
¡ Inglefinger study of NEJM reviewers:
l Concordance of reviews only slightly better than chance
l Reviewers not skilled in all areas of a study, unable to
discern poor writing and have their own biases