Compliance with methodological standards when evaluating ophthalmic diagnostic tests - PubMed
Affiliations
- PMID: 10393031
Compliance with methodological standards when evaluating ophthalmic diagnostic tests
R Harper et al. Invest Ophthalmol Vis Sci. 1999 Jul.
Abstract
Purpose: To draw attention to the importance of methodological standards when carrying out evaluations of ophthalmic diagnostic tests by reviewing the extent of compliance with these standards in reports of evaluations published within the ophthalmic literature.
Methods: Twenty published evaluations of ophthalmic screening/diagnostic tests or technologies were independently assessed by two reviewers for compliance with the following methodological standards: specification of the spectrum composition for populations used in the evaluation, analysis of pertinent subgroups, avoidance of work-up (verification) bias, avoidance of review bias, presentation of precision of results for test accuracy, presentation of indeterminate test results, and presentation of test reproducibility.
Results: Compliance ranged from just 10% (95%CI, 1%-32%) for presentation of test reproducibility data and avoidance of review bias to 70% (95%CI, 46%-88%) for avoidance of work-up bias and presentation of indeterminate test results. Only 5 of the 20 evaluations complied with four or more of the methodological standards and none with more than five of the standards.
Conclusions: The evaluations of ophthalmic diagnostic tests discussed in this article show limited compliance with accepted methodological standards but are no worse than previously described for evaluations published in general medical journals. Adherence to these standards by researchers can improve the study design and reporting of evaluations of new diagnostic techniques. Limited compliance, combined with a lack of awareness of the standards among users of research evidence, may lead to the inappropriate adoption of new diagnostic technologies, with a consequent waste of health care resources.
Similar articles
-
The quality of reporting of diagnostic accuracy studies published in ophthalmic journals.
Siddiqui MA, Azuara-Blanco A, Burr J. Siddiqui MA, et al. Br J Ophthalmol. 2005 Mar;89(3):261-5. doi: 10.1136/bjo.2004.051862. Br J Ophthalmol. 2005. PMID: 15722299 Free PMC article.
-
Diagnostic accuracy of flow rate testing in urology.
Patel HR, Garcia-Montes F, Christopher N, Reeves BC, Emberton M. Patel HR, et al. BJU Int. 2003 Jul;92(1):58-63. BJU Int. 2003. PMID: 12823384 Review.
-
[Research on diagnostic tests in Medicina Clinica. A methodological assessment].
Ramos Rincón JM, Hernández Aguado I. Ramos Rincón JM, et al. Med Clin (Barc). 1998 Jul 4;111(4):129-34. Med Clin (Barc). 1998. PMID: 9717144 Spanish.
-
[Methods for evaluating diagnostic tests in Enfermedades Infecciosas y Microbiología Clínica].
Ramos JM, Hernández I. Ramos JM, et al. Enferm Infecc Microbiol Clin. 1998 Apr;16(4):179-84. Enferm Infecc Microbiol Clin. 1998. PMID: 9646562 Review. Spanish.
-
Use of methodological standards in diagnostic test research. Getting better but still not good.
Reid MC, Lachs MS, Feinstein AR. Reid MC, et al. JAMA. 1995 Aug 23-30;274(8):645-51. JAMA. 1995. PMID: 7637146
Cited by
-
Appraising evaluations of screening/diagnostic tests: the importance of the study populations.
Harper R, Henson D, Reeves BC. Harper R, et al. Br J Ophthalmol. 2000 Oct;84(10):1198-202. doi: 10.1136/bjo.84.10.1198. Br J Ophthalmol. 2000. PMID: 11004111 Free PMC article. No abstract available.
-
Reeves BC. Reeves BC. Br J Ophthalmol. 2005 Mar;89(3):253-4. doi: 10.1136/bjo.2004.055640. Br J Ophthalmol. 2005. PMID: 15722296 Free PMC article. No abstract available.
-
The quality of reporting of diagnostic accuracy studies published in ophthalmic journals.
Siddiqui MA, Azuara-Blanco A, Burr J. Siddiqui MA, et al. Br J Ophthalmol. 2005 Mar;89(3):261-5. doi: 10.1136/bjo.2004.051862. Br J Ophthalmol. 2005. PMID: 15722299 Free PMC article.
-
Reporting of precision of estimates for diagnostic accuracy: a review.
Harper R, Reeves B. Harper R, et al. BMJ. 1999 May 15;318(7194):1322-3. doi: 10.1136/bmj.318.7194.1322. BMJ. 1999. PMID: 10323817 Free PMC article. Review. No abstract available.
-
Test characteristics of orthoptic screening examination in 3 year old kindergarten children.
Barry JC, König HH. Barry JC, et al. Br J Ophthalmol. 2003 Jul;87(7):909-16. doi: 10.1136/bjo.87.7.909. Br J Ophthalmol. 2003. PMID: 12812897 Free PMC article.
MeSH terms
LinkOut - more resources
Full Text Sources