Publication bias: Difference between revisions

From Citizendium
Jump to navigation Jump to search
imported>Robert Badgett
No edit summary
imported>Robert Badgett
(Moved in content from Evidence-based medicine article)
Line 1: Line 1:
{{subpages}}
{{subpages}}
'''Publication bias''' is defined as "the influence of study results on the chances of publication [in [[academic journal]]s] and the tendency of investigators, reviewers, and editors to submit or accept manuscripts for publication based on the direction or strength of the study findings. Publication bias has an impact on the interpretation of clinical trials and meta-analyses. Bias can be minimized by insistence by editors on high-quality research, thorough literature reviews, acknowledgement of conflicts of interest, modification of peer review practices, etc."<ref name="title">{{cite web |url=http://www.nlm.nih.gov/cgi/mesh/2007/MB_cgi?term=publication+bias |title=Publication bias |accessdate=2007-12-17 |author=National Library of Medicine |authorlink= |coauthors= |date= |format= |work= |publisher= |pages= |language= |archiveurl= |archivedate= |quote=}}</ref> Publication bias has been documented to occur<ref name="pmid1727960">{{cite journal |author=Dickersin K, Min YI, Meinert CL |title=Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards |journal=JAMA |volume=267 |issue=3 |pages=374–8 |year=1992 |pmid=1727960 |doi=}}</ref>.
'''Publication bias''' is defined as "the influence of study results on the chances of publication [in [[academic journal]]s] and the tendency of investigators, reviewers, and editors to submit or accept manuscripts for publication based on the direction or strength of the study findings. Publication bias has an impact on the interpretation of clinical trials and meta-analyses. Bias can be minimized by insistence by editors on high-quality research, thorough literature reviews, acknowledgment of conflicts of interest, modification of peer review practices, etc."<ref name="title">{{cite web |url=http://www.nlm.nih.gov/cgi/mesh/2007/MB_cgi?term=publication+bias |title=Publication bias |accessdate=2007-12-17 |author=National Library of Medicine |authorlink= |coauthors= |date= |format= |work= |publisher= |pages= |language= |archiveurl= |archivedate= |quote=}}</ref> Publication bias has been documented to occur<ref name="pmid1727960">{{cite journal |author=Dickersin K, Min YI, Meinert CL |title=Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards |journal=JAMA |volume=267 |issue=3 |pages=374–8 |year=1992 |pmid=1727960 |doi=}}</ref>.


Publication bias may be due to authors not submitting negative studies for publication.<ref name="pmid12876092">{{cite journal |author=Krzyzanowska MK, Pintilie M, Tannock IF |title=Factors associated with failure to publish large randomized trials presented at an oncology meeting |journal=JAMA |volume=290 |issue=4 |pages=495–501 |year=2003 |pmid=12876092 |doi=10.1001/jama.290.4.495}}</ref> This may especially be true of studies authored by industries with conflicts of interest.<ref name="pmid12775615">{{cite journal |author=Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B |title=Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications |journal=BMJ |volume=326 |issue=7400 |pages=1171–3 |year=2003 |pmid=12775615 |doi=10.1136/bmj.326.7400.1171}}</ref>
Whether a treatment or medical intervention is effective or not may be judged either by the experience of the practising physician, or by what has been published by others. The publications with greatest authority are generally those in the peer-reviewed scientific [[academic journal|journals]], and particularly those [[academic journal|journals]] with the highest standards of editorial scrutiny. However, it is not simple to get a study published in any peer-reviewed journal, least of all in the best [[academic journal|journals]]. Accordingly, many studies go unreported. It is often thought to be difficult to publish small studies, the outcome of which conflicts with the reported outcomes of larger previously published studies, or to publish studies from which no clear conclusion can be drawn. In part, this reflects the wish of the best [[academic journal|journals]] to publish influential papers, and in part it reflects authors choosing not to publish studies that are thought to be uninteresting. Such ''publication bias'' can be difficult to recognise, but its effects tend to encourage publication of studies that support an already formed conclusion, while discouraging publication of contradictory or equivocal findings.<ref name="pmid1727960">{{cite journal |author=Dickersin K ''et al.'' |title=Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards |journal=JAMA |volume=267 |pages=374–8 |year=1992 |pmid=1727960 |doi=}}</ref><ref name="pmid12876092">{{cite journal |author=Krzyzanowska MK ''et al.''|title=Factors associated with failure to publish large randomized trials presented at an oncology meeting |journal=JAMA |volume=290 |pages=495–501 |year=2003 |pmid=12876092 |doi=10.1001/jama.290.4.495}}</ref>
 
Publication bias may be due to authors not submitting negative studies for publication.<ref name="pmid12876092">{{cite journal |author=Krzyzanowska MK, Pintilie M, Tannock IF |title=Factors associated with failure to publish large randomized trials presented at an oncology meeting |journal=JAMA |volume=290 |issue=4 |pages=495–501 |year=2003 |pmid=12876092 |doi=10.1001/jama.290.4.495}}</ref> This may especially be true of studies authored by industries with conflicts of interest.<ref name="pmid12775615">{{cite journal |author=Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B |title=Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications |journal=BMJ |volume=326 |issue=7400 |pages=1171–3 |year=2003 |pmid=12775615 |doi=10.1136/bmj.326.7400.1171}}</ref><ref name="pmid12775614">{{cite journal |author=Lexchin J ''et al.''|title=Pharmaceutical industry sponsorship and research outcome and quality: systematic review |journal=BMJ |volume=326 |pages=1167–70 |year=2003 |pmid=12775614 |doi=10.1136/bmj.326.7400.1167}}</ref>


Publication bias, or bias in interpretation of studies, may be more common in certain areas of study and maybe also be associated with the language the study in published in. In the field of complementary and [[alternative medicine]] (CAM), publication bias may be more likely to occur in studies published in languages of than English.<ref name="pmid16086467">{{cite journal |author=Pham B, Klassen TP, Lawson ML, Moher D |title=Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary |journal=J Clin Epidemiol |volume=58 |issue=8 |pages=769–76 |year=2005 |pmid=16086467 |doi= |issn=}}</ref> This may be due to typical CAM studies being smaller than trials of conventional medicine<ref name="pmid16086467"/>. According to two European analyses, both including German authors and one from the German [[Cochrane Collaboration|Cochrane]] Center, this bias may be especially prevelent in German publications.<ref name="pmid16824217">{{cite journal |author=Galandi D, Schwarzer G, Antes G |title=The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004 |journal=BMC Med Res Methodol |volume=6 |issue= |pages=30 |year=2006 |pmid=16824217 |doi=10.1186/1471-2288-6-30 |issn=}}</ref name="pmid9251637">Lancet. 1997. Language bias in randomised controlled trials published in English and German. http://pubmed.gov/16086467</ref>
Publication bias, or bias in interpretation of studies, may be more common in certain areas of study and maybe also be associated with the language the study in published in. In the field of complementary and [[alternative medicine]] (CAM), publication bias may be more likely to occur in studies published in languages of than English.<ref name="pmid16086467">{{cite journal |author=Pham B, Klassen TP, Lawson ML, Moher D |title=Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary |journal=J Clin Epidemiol |volume=58 |issue=8 |pages=769–76 |year=2005 |pmid=16086467 |doi= |issn=}}</ref> This may be due to typical CAM studies being smaller than trials of conventional medicine<ref name="pmid16086467"/>. According to two European analyses, both including German authors and one from the German [[Cochrane Collaboration|Cochrane]] Center, this bias may be especially prevelent in German publications.<ref name="pmid16824217">{{cite journal |author=Galandi D, Schwarzer G, Antes G |title=The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004 |journal=BMC Med Res Methodol |volume=6 |issue= |pages=30 |year=2006 |pmid=16824217 |doi=10.1186/1471-2288-6-30 |issn=}}</ref name="pmid9251637">Lancet. 1997. Language bias in randomised controlled trials published in English and German. http://pubmed.gov/16086467</ref>
Line 10: Line 12:
==Meta-analysis==
==Meta-analysis==
Publication bias is a major threat to the validity of [[meta-analysis]]. Publication bias against negative studies may threaten the validity of [[meta-analysis|meta-analyses]] that are positive and all the studies included within the meta-analysis are small.<ref name="pmid10845965">{{cite journal |author=Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR |title=Empirical assessment of effect of publication bias on meta-analyses |journal=BMJ |volume=320 |issue=7249 |pages=1574–7 |year=2000 |pmid=10845965 |doi=}}</ref><ref name="pmid9310563">{{cite journal |author=Egger M, Davey Smith G, Schneider M, Minder C |title=Bias in meta-analysis detected by a simple, graphical test |journal=BMJ |volume=315 |issue=7109 |pages=629–34 |year=1997 |pmid=9310563 |doi=}}</ref>
Publication bias is a major threat to the validity of [[meta-analysis]]. Publication bias against negative studies may threaten the validity of [[meta-analysis|meta-analyses]] that are positive and all the studies included within the meta-analysis are small.<ref name="pmid10845965">{{cite journal |author=Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR |title=Empirical assessment of effect of publication bias on meta-analyses |journal=BMJ |volume=320 |issue=7249 |pages=1574–7 |year=2000 |pmid=10845965 |doi=}}</ref><ref name="pmid9310563">{{cite journal |author=Egger M, Davey Smith G, Schneider M, Minder C |title=Bias in meta-analysis detected by a simple, graphical test |journal=BMJ |volume=315 |issue=7109 |pages=629–34 |year=1997 |pmid=9310563 |doi=}}</ref>
In performing a [[meta-analysis|meta-analyses]], a file drawer<ref name="pmid11523382">{{cite journal |author=Pham B ''et al.'' |title=Is there a "best" way to detect and minimize publication bias? An empirical evaluation |journal=Evaluation & the Health Professions |volume=24  |pages=109–25 |year=2001 |pmid=11523382 |doi=}}</ref> or a funnel plot analysis<ref name="pmid9310563">{{cite journal |author=Egger M ''et al.'' |title=Bias in meta-analysis detected by a simple, graphical test |journal=BMJ |volume=315 |pages=629–34 |year=1997 |pmid=9310563 |doi=}}</ref><ref name="pmid16085192">{{cite journal |author=Terrin N ''et al.'' |title=In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias |journal=J Clin Epidemiol |volume=58 |pages=894–901 |year=2005 |pmid=16085192 |doi=10.1016/j.jclinepi.2005.01.006}}</ref> may help detect underlying publication bias among the studies in the meta-analysis.


==References==
==References==
<references/>
<references/>

Revision as of 14:35, 12 March 2008

This article is developing and not approved.
 Main Article
 Discussion
Related Articles  [?]
Bibliography  [?]
External Links  [?]
Citable Version  [?]
 
https://en.citizendium.org/wiki/index.php?title=Publication_bias&printable=yes
This editable Main Article is under development and subject to a disclaimer.

Publication bias is defined as "the influence of study results on the chances of publication [in academic journals] and the tendency of investigators, reviewers, and editors to submit or accept manuscripts for publication based on the direction or strength of the study findings. Publication bias has an impact on the interpretation of clinical trials and meta-analyses. Bias can be minimized by insistence by editors on high-quality research, thorough literature reviews, acknowledgment of conflicts of interest, modification of peer review practices, etc."[1] Publication bias has been documented to occur[2].

Whether a treatment or medical intervention is effective or not may be judged either by the experience of the practising physician, or by what has been published by others. The publications with greatest authority are generally those in the peer-reviewed scientific journals, and particularly those journals with the highest standards of editorial scrutiny. However, it is not simple to get a study published in any peer-reviewed journal, least of all in the best journals. Accordingly, many studies go unreported. It is often thought to be difficult to publish small studies, the outcome of which conflicts with the reported outcomes of larger previously published studies, or to publish studies from which no clear conclusion can be drawn. In part, this reflects the wish of the best journals to publish influential papers, and in part it reflects authors choosing not to publish studies that are thought to be uninteresting. Such publication bias can be difficult to recognise, but its effects tend to encourage publication of studies that support an already formed conclusion, while discouraging publication of contradictory or equivocal findings.[2][3]

Publication bias may be due to authors not submitting negative studies for publication.[3] This may especially be true of studies authored by industries with conflicts of interest.[4][5]

Publication bias, or bias in interpretation of studies, may be more common in certain areas of study and maybe also be associated with the language the study in published in. In the field of complementary and alternative medicine (CAM), publication bias may be more likely to occur in studies published in languages of than English.[6] This may be due to typical CAM studies being smaller than trials of conventional medicine[6]. According to two European analyses, both including German authors and one from the German Cochrane Center, this bias may be especially prevelent in German publications.[7]

An example of probable publication bias is in the studies of glucosamine and chondroitin for treatment of osteoarthritis. In an initial meta-analysis, the authors noted evidence of publication bias during examination of the results.[8] A subsequent large randomized controlled trial[9] and meta-analyses including the large trial were negative[10][11]. Another example is the selective publication of randomized controlled trials of antidepressant.[12]

Meta-analysis

Publication bias is a major threat to the validity of meta-analysis. Publication bias against negative studies may threaten the validity of meta-analyses that are positive and all the studies included within the meta-analysis are small.[13][14]

In performing a meta-analyses, a file drawer[15] or a funnel plot analysis[14][16] may help detect underlying publication bias among the studies in the meta-analysis.


References

  1. ↑ National Library of Medicine. Publication bias. Retrieved on 2007-12-17.
  2. ↑ 2.0 2.1 Dickersin K, Min YI, Meinert CL (1992). "Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards". JAMA 267 (3): 374–8. PMID 1727960. [e] Cite error: Invalid <ref> tag; name "pmid1727960" defined multiple times with different content
  3. ↑ 3.0 3.1 Krzyzanowska MK et al. (2003). "Factors associated with failure to publish large randomized trials presented at an oncology meeting". JAMA 290: 495–501. DOI:10.1001/jama.290.4.495. PMID 12876092. Research Blogging. Cite error: Invalid <ref> tag; name "pmid12876092" defined multiple times with different content
  4. ↑ Melander H, Ahlqvist-Rastad J, Meijer G, Beermann B (2003). "Evidence b(i)ased medicine--selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications". BMJ 326 (7400): 1171–3. DOI:10.1136/bmj.326.7400.1171. PMID 12775615. Research Blogging.
  5. ↑ Lexchin J et al. (2003). "Pharmaceutical industry sponsorship and research outcome and quality: systematic review". BMJ 326: 1167–70. DOI:10.1136/bmj.326.7400.1167. PMID 12775614. Research Blogging.
  6. ↑ 6.0 6.1 Pham B, Klassen TP, Lawson ML, Moher D (2005). "Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary". J Clin Epidemiol 58 (8): 769–76. PMID 16086467. [e]
  7. ↑ Galandi D, Schwarzer G, Antes G (2006). "The demise of the randomised controlled trial: bibliometric study of the German-language health care literature, 1948 to 2004". BMC Med Res Methodol 6: 30. DOI:10.1186/1471-2288-6-30. PMID 16824217. Research Blogging. </ref name="pmid9251637">Lancet. 1997. Language bias in randomised controlled trials published in English and German. http://pubmed.gov/16086467
  8. ↑ McAlindon TE, LaValley MP, Gulin JP, Felson DT (2000). "Glucosamine and chondroitin for treatment of osteoarthritis: a systematic quality assessment and meta-analysis". JAMA 283 (11): 1469–75. PMID 10732937. [e]
  9. ↑ Clegg DO, Reda DJ, Harris CL, et al (2006). "Glucosamine, chondroitin sulfate, and the two in combination for painful knee osteoarthritis". N. Engl. J. Med. 354 (8): 795–808. DOI:10.1056/NEJMoa052771. PMID 16495392. Research Blogging.
  10. ↑ Vlad SC, LaValley MP, McAlindon TE, Felson DT (2007). "Glucosamine for pain in osteoarthritis: why do trial results differ?". Arthritis Rheum. 56 (7): 2267–77. DOI:10.1002/art.22728. PMID 17599746. Research Blogging.
  11. ↑ Reichenbach S, Sterchi R, Scherer M, et al (2007). "Meta-analysis: chondroitin for osteoarthritis of the knee or hip". Ann. Intern. Med. 146 (8): 580–90. PMID 17438317. [e]
  12. ↑ Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R (2008). "Selective publication of antidepressant trials and its influence on apparent efficacy". N. Engl. J. Med. 358 (3): 252–60. DOI:10.1056/NEJMsa065779. PMID 18199864. Research Blogging.
  13. ↑ Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR (2000). "Empirical assessment of effect of publication bias on meta-analyses". BMJ 320 (7249): 1574–7. PMID 10845965. [e]
  14. ↑ 14.0 14.1 Egger M, Davey Smith G, Schneider M, Minder C (1997). "Bias in meta-analysis detected by a simple, graphical test". BMJ 315 (7109): 629–34. PMID 9310563. [e] Cite error: Invalid <ref> tag; name "pmid9310563" defined multiple times with different content
  15. ↑ Pham B et al. (2001). "Is there a "best" way to detect and minimize publication bias? An empirical evaluation". Evaluation & the Health Professions 24: 109–25. PMID 11523382. [e]
  16. ↑ Terrin N et al. (2005). "In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias". J Clin Epidemiol 58: 894–901. DOI:10.1016/j.jclinepi.2005.01.006. PMID 16085192. Research Blogging.
Retrieved from "https://citizendium.org/wiki/index.php?title=Publication_bias&oldid=360081"