peer review processIn the peer review process, a paper is submitted to a journal and evaluated by several reviewers.  (Reviewers are often individuals with an impressive history of work in the area of interest, that is, the specific area that the article addresses).  After critiquing the paper the reviewers submit their thoughts to the editor.  Then, based on the commentaries from the reviewers, the editor decides whether to publish the paper, make suggestions for additional changes that could lead to publication, or reject the paper.

The primary purpose of peer review is to ensure that the papers published are valid and unbiased.

Single Blind and Double Blind Reviews

In single blind reviews authors do not know who the reviewers are.  In double blind reviews authors do not know who the reviewers are, nor do reviewers know the identity of the authors.  In many fields single blind reviews are the norm, while in others double blind reviews are preferred.

“Peer review is one way (replication is another) science institutionalizes the attitudes of objectivity and public criticism.  Ideas and experimentation undergo a honing process in which they are submitted to other critical minds for evaluation.  Ideas that survive this critical process have begun to meet the criterion of public verifiability” (Stanovich, 2007, p. 12).

Peer Review Criticisms

The peer review process is not infallible.  Criticisms include:

  • Reviewers find it hard to remain purely objective due to their own education, experience and preconceived notions
  • The process is slow
  • Critics point out that there are many examples of faulty research published in peer-reviewed journals, which shows the peer review process is often unsuccessful in weeding out bad science
  • Reviewers tend to be highly critical of articles that contradict their own views, while being less critical of articles that support their personal views (this is an example of “myside bias”)
  • Well-known, established scientists are more likely to be recruited as reviewers

Conclusion

The peer review process is not perfect, but it is the best safeguard we have against junk science. When evaluating the worth of scientific data, in addition to verifying its publication in a peer-reviewed journal, it is important to take into consideration:  funding sources, whether the study has been replicated, study design, sample size, and conflicting interest (design details and critiques will be discussed in later articles).

When referencing scientific data, it is common for individuals to reference popular science magazines and books.  Be extra cautious when getting your science information from these sources.

Of course, there is some good science information published in popular science publications.   But, when the authors cannot provide references for their scientific statements, and/or their claims contradict those found in peer reviewed science journals, don’t place much weight on what they’re saying.

References

Stanovich, K. (2007).  How To Think Straight About Psychology, 8th edition. Boston, MA: Pearson.

Photo by Sean Winters, available under a Creative Commons attribution license.

 


Comments


View Comments / Leave a Comment

This post currently has 3 comments.
You can read the comments or leave your own thoughts.

Trackbacks

No trackbacks yet to this post.


    Last reviewed: By John M. Grohol, Psy.D. on 18 Apr 2011
    Published on PsychCentral.com. All rights reserved.

APA Reference
Hale, J. (2011). Understanding Research Methodology 4: Peer Review Process. Psych Central. Retrieved on December 21, 2014, from http://psychcentral.com/blog/archives/2011/04/18/understanding-research-methodology-4-peer-review-process/

 

Recent Comments
  • Seducelove: Women and men communicate in entirely different ways, especially these days that women have become more...
  • Mike: This was such a good read that I took time out to leave a comment (on an unknown website with an unknown...
  • Amanda: 2 days ago I started having flu like symptoms col hot headache nausea sore body extreme lack of energy the...
  • anonymous: Are you kidding me? A victim of this would actually choose this life? And that’s what I’m...
  • 707: So basically, if you can’t afford it, you’re screwed.
Subscribe to Our Weekly Newsletter


Find a Therapist
Enter ZIP or postal code



Users Online: 6882
Join Us Now!