World of Psychology

Contradicted and Initially Stronger Effects in Highly Cited Clinical Research

So you know all that research published and trumpeted in the nightly news (and all over the Net) about the latest health findings? Well, 32% of that research is subsequently discovered not to be so strong, or downright wrong:

Of 49 highly cited original clinical research studies, 45 claimed that the intervention was effective. Of these, 7 (16%) were contradicted by subsequent studies, 7 others (16%) had found effects that were stronger than those of subsequent studies, 20 (44%) were replicated, and 11 (24%) remained largely unchallenged. Five of 6 highly-cited nonrandomized studies had been contradicted or had found stronger effects vs 9 of 39 randomized controlled trials (P = .008). Among randomized trials, studies with contradicted or stronger effects were smaller (P = .009) than replicated or unchallenged studies although there was no statistically significant difference in their early or overall citation impact. Matched control studies did not have a significantly different share of refuted results than highly cited studies, but they included more studies with “negative” results.

This is, of course, one of the points of research — to have the results replicated (or not) to discover if the results are robust, and therefore, that treatment decisions should be made upon them. You simply can’t do that unless you do the initial research and publish the results somewhere (like in a peer-reviewed journal).

Via JAMA.


1 Star2 Stars3 Stars4 Stars5 Stars (No Ratings Yet)
Loading ... Loading ...

You can skip to the end and leave a response. Pinging is currently not allowed.

Join the Conversation! Post a Comment:


(Required, will be published)

(Required, but will not be published)

(Optional)


    Last reviewed: By John M. Grohol, Psy.D. on 13 Jul 2005

 


Recent Comments
  • Scott Volltrauer: I enjoyed this article and saved it for a client. I felt that she would appreciate it’s...
  • Dee: Bonnie, I am sorry if you feel like anything I have said hurts you. This is not my intention. I do feel for you...
  • Allison: It IS unethical for a therapist to drop you without notice. A therapist *supposedly) is trained to handle...
  • vivalaleta: Have any studies been done to ascertain whether the correlation between bipolarity and these suicides...
  • men.attracted.to.women: Hi pleasant post. I believe these points might be structural too. Now the solid pick up lines...
Article Tools
Bookmark
Print
Email Friend


Stumble It!


Subscribe to Our Weekly Newsletter


Users Online: 1424
Join Us Now!




Follow us on Twitter!

Find us on Facebook!