pubmed.ncbi.nlm.nih.gov

Publication Bias and Nonreporting Found in Majority of Systematic Reviews and Meta-analyses in Anesthesiology Journals - PubMed

Review

Publication Bias and Nonreporting Found in Majority of Systematic Reviews and Meta-analyses in Anesthesiology Journals

Riley J Hedin et al. Anesth Analg. 2016 Oct.

Abstract

Background: Systematic reviews and meta-analyses are used by clinicians to derive treatment guidelines and make resource allocation decisions in anesthesiology. One cause for concern with such reviews is the possibility that results from unpublished trials are not represented in the review findings or data synthesis. This problem, known as publication bias, results when studies reporting statistically nonsignificant findings are left unpublished and, therefore, not included in meta-analyses when estimating a pooled treatment effect. In turn, publication bias may lead to skewed results with overestimated effect sizes. The primary objective of this study is to determine the extent to which evaluations for publication bias are conducted by systematic reviewers in highly ranked anesthesiology journals and which practices reviewers use to mitigate publication bias. The secondary objective of this study is to conduct publication bias analyses on the meta-analyses that did not perform these assessments and examine the adjusted pooled effect estimates after accounting for publication bias.

Methods: This study considered meta-analyses and systematic reviews from 5 peer-reviewed anesthesia journals from 2007 through 2015. A PubMed search was conducted, and full-text systematic reviews that fit inclusion criteria were downloaded and coded independently by 2 authors. Coding was then validated, and disagreements were settled by consensus. In total, 207 systematic reviews were included for analysis. In addition, publication bias evaluation was performed for 25 systematic reviews that did not do so originally. We used Egger regression, Duval and Tweedie trim and fill, and funnel plots for these analyses.

Results: Fifty-five percent (n = 114) of the reviews discussed publication bias, and 43% (n = 89) of the reviews evaluated publication bias. Funnel plots and Egger regression were the most common methods for evaluating publication bias. Publication bias was reported in 34 reviews (16%). Thirty-six of the 45 (80.0%) publication bias analyses indicated the presence of publication bias by trim and fill analysis, whereas Egger regression indicated publication bias in 23 of 45 (51.1%) analyses. The mean absolute percent difference between adjusted and observed point estimates was 15.5%, the median was 6.2%, and the range was 0% to 85.5%.

Conclusions: Many of these reviews reported following published guidelines such as PRISMA or MOOSE, yet only half appropriately addressed publication bias in their reviews. Compared with previous research, our study found fewer reviews assessing publication bias and greater likelihood of publication bias among reviews not performing these evaluations.

PubMed Disclaimer

Comment in

  • Publication Bias: The Elephant in the Review.

    Dalton JE, Bolen SD, Mascha EJ. Dalton JE, et al. Anesth Analg. 2016 Oct;123(4):812-3. doi: 10.1213/ANE.0000000000001596. Anesth Analg. 2016. PMID: 27636569 Free PMC article. No abstract available.

  • In Response.

    Hedin R, Vassar M. Hedin R, et al. Anesth Analg. 2017 May;124(5):1737-1738. doi: 10.1213/ANE.0000000000001978. Anesth Analg. 2017. PMID: 28319510 No abstract available.

  • Irony and the Elephant in the Review.

    Grocott HP, Deutscher R. Grocott HP, et al. Anesth Analg. 2017 May;124(5):1736-1737. doi: 10.1213/ANE.0000000000001979. Anesth Analg. 2017. PMID: 28319518 No abstract available.

Similar articles

Cited by

Publication types

MeSH terms

LinkOut - more resources