pubmed.ncbi.nlm.nih.gov

A SIMEX approach for meta-analysis of diagnostic accuracy studies with attention to ROC curves - PubMed

  • ️Sat Jan 01 2022

Meta-Analysis

. 2022 Oct 27;19(2):455-471.

doi: 10.1515/ijb-2022-0012. eCollection 2023 Nov 1.

Affiliations

Free article

Meta-Analysis

A SIMEX approach for meta-analysis of diagnostic accuracy studies with attention to ROC curves

Annamaria Guolo et al. Int J Biostat. 2022.

Free article

Abstract

Bivariate random-effects models represent an established approach for meta-analysis of accuracy measures of a diagnostic test, which are typically given by sensitivity and specificity. A recent formulation of the classical model describes the test accuracy in terms of study-specific Receiver Operating Characteristics curves. In this way, the resulting summary curve can be thought of as an average of the study-specific Receiver Operating Characteristics curves. Within this framework, the paper shows that the standard likelihood approach for inference is prone to several issues. Small sample size can give rise to unreliable conclusions and convergence problems deeply affect the analysis. The proposed alternative is a simulation-extrapolation method, called SIMEX, developed within the measurement error literature. It suits the meta-analysis framework, as the accuracy measures provided by the studies are estimates rather than true values, and thus are prone to error. The methods are compared in a series of simulation studies, covering different scenarios of interest, including deviations from normality assumptions. SIMEX reveals a satisfactory strategy, providing more accurate inferential results if compared to the likelihood approach, while avoiding convergence failure. The approaches are applied to a meta-analysis of the accuracy of the ultrasound exam for diagnosing abdominal tuberculosis in HIV-positive subjects.

Keywords: ROC curve; SIMEX; diagnostic test; likelihood inference; multivariate meta-analysis.

© 2022 the author(s), published by De Gruyter, Berlin/Boston.

PubMed Disclaimer

Similar articles

References

    1. Reitsma, JB, Glas, AS, Rutjes, AWS, Scholten, RJPM, Bossuyt, PM, Zwinderman, AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 2005;58:982–90. https://doi.org/10.1016/j.jclinepi.2005.02.022 . - DOI
    1. Arends, LR, Hamza, TH, van Houwelingen, JC, Heijenbrok-Kal, MH, Hunink, MGM, Stijnen, T. Bivariate random effects meta-analysis of ROC curves. Med Decis Making 2008;28:621–38. https://doi.org/10.1177/0272989x08319957 . - DOI
    1. Hamza, TH, Arends, LR, van Houwelingen, HC, Stijnen, T. Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds. BMC Med Res Methodol 2009;9:73. https://doi.org/10.1186/1471-2288-9-73 . - DOI
    1. Ma, X, Nie, L, Cole, SR, Chu, H. Statistical methods for multivariate meta-analysis of diagnostic tests: an overview and tutorial. Stat Methods Med Res 2016;25:1596–619. https://doi.org/10.1177/0962280213492588 . - DOI
    1. Littenberg, B, Moses, LE. Estimating diagnostic accuracy from multiple conflicting reports: a new meta- analytic method. Med Decis Making 1993;13:313–21. https://doi.org/10.1177/0272989x9301300408 . - DOI

Publication types

MeSH terms

LinkOut - more resources