Sensitivity and specificity: Difference between revisions
imported>Robert Badgett |
imported>Robert Badgett (Added 'Predictiveness curve' and 'Sequential scoring') |
||
| Line 1: | Line 1: | ||
{{subpages}} | {{subpages}} | ||
The '''sensitivity and specificity''' of diagnostic | The '''sensitivity and specificity''' of [[diagnostic test]]s are based on [[Bayes Theorem]] and defined as "measures for assessing the results of diagnostic and screening tests. Sensitivity represents the proportion of truly diseased persons in a screened population who are identified as being diseased by the test. It is a measure of the probability of correctly diagnosing a condition. Specificity is the proportion of truly nondiseased persons who are so identified by the screening test. It is a measure of the probability of correctly identifying a nondiseased person. (From Last, Dictionary of Epidemiology, 2d ed)."<ref name="MeSH_SnSp">{{cite web |url=http://www.nlm.nih.gov/cgi/mesh/2007/MB_cgi?term=Sensitivity+and+Specificity |title=Sensitivity and specificity |accessdate=2007-12-09 |author=National Library of Mediicne |authorlink= |coauthors= |date= |format= |work= |publisher= |pages= |language= |archiveurl= |archivedate= |quote=}}</ref> | ||
Successful application of sensitivity and specificity is an important part of practicing [[evidence-based medicine]]. | Successful application of sensitivity and specificity is an important part of practicing [[evidence-based medicine]]. | ||
| Line 45: | Line 45: | ||
===Sum of sensitivity and specificity=== | ===Sum of sensitivity and specificity=== | ||
This easy metric is called S+T.<ref name="pmid4014166">{{cite journal |author=Connell FA, Koepsell TD |title=Measures of gain in certainty from a diagnostic test |journal=Am. J. Epidemiol. |volume=121 |issue=5 |pages=744–53 |year=1985 |month=May |pmid=4014166 |doi= |url=http://aje.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=4014166 |issn=}}</ref> It varies from 0 to 2 and a result of 1 indicates that the diagnostic test does not add to guessing. | This easy metric is called S+T.<ref name="pmid4014166">{{cite journal |author=Connell FA, Koepsell TD |title=Measures of gain in certainty from a diagnostic test |journal=Am. J. Epidemiol. |volume=121 |issue=5 |pages=744–53 |year=1985 |month=May |pmid=4014166 |doi= |url=http://aje.oxfordjournals.org/cgi/pmidlookup?view=long&pmid=4014166 |issn=}}</ref> It varies from 0 to 2 and a result of 1 indicates that the diagnostic test does not add to guessing. | ||
===Predictiveness curve=== | |||
A graph of the predictiveness curve has been proposed.<ref>{{Cite journal | doi = 10.1093/aje/kwm305 | volume = 167 | issue = 3 | pages = 362-368 | last = Pepe | first = Margaret S. | coauthors = Ziding Feng, Ying Huang, Gary Longton, Ross Prentice, Ian M. Thompson, Yingye Zheng | title = Integrating the Predictiveness of a Marker with Its Performance as a Classifier | journal = Am. J. Epidemiol. | pmid=17982157 | accessdate = 2008-12-17 | date = 2008-02-01 | url = http://aje.oxfordjournals.org/cgi/content/abstract/167/3/362 }}</ref> | |||
===Proportionate reduction in uncertainty score=== | ===Proportionate reduction in uncertainty score=== | ||
| Line 54: | Line 57: | ||
===Reclassification tables=== | ===Reclassification tables=== | ||
This measure has been proposed as an alternative to the area of the the [[receiver operating characteristic curve]].<ref name="pmid17569110">{{cite journal |author=Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS |title=Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond |journal=Stat Med |volume=27 |issue=2 |pages=157–72; discussion 207–12 |year=2008 |month=January |pmid=17569110 |doi=10.1002/sim.2929 |url=http://dx.doi.org/10.1002/sim.2929 |issn=}}</ref> This method allows calculating a 'reclassification index' or 'reclassification rate', or 'net reclassification improvement' (NRI)<ref name="pmid17569110">{{cite journal |author=Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS |title=Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond |journal=Stat Med |volume=27 |issue=2 |pages=157–72; discussion 207–12 |year=2008 |month=January |pmid=17569110 |doi=10.1002/sim.2929 |url=http://dx.doi.org/10.1002/sim.2929 |issn=}}</ref>. | This measure has been proposed as an alternative to the area of the the [[receiver operating characteristic curve]].<ref name="pmid17569110">{{cite journal |author=Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS |title=Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond |journal=Stat Med |volume=27 |issue=2 |pages=157–72; discussion 207–12 |year=2008 |month=January |pmid=17569110 |doi=10.1002/sim.2929 |url=http://dx.doi.org/10.1002/sim.2929 |issn=}}</ref> This method allows calculating a 'reclassification index' or 'reclassification rate', or 'net reclassification improvement' (NRI)<ref name="pmid17569110">{{cite journal |author=Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS |title=Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond |journal=Stat Med |volume=27 |issue=2 |pages=157–72; discussion 207–12 |year=2008 |month=January |pmid=17569110 |doi=10.1002/sim.2929 |url=http://dx.doi.org/10.1002/sim.2929 |issn=}}</ref>. | ||
===Sequential scoring=== | |||
Sequential scoring has been proposed in order to isolate the effect of a new, expensive [[diagnostic test]].<ref name="pmid17729377">{{cite journal |author=Greenland S |title=The need for reorientation toward cost-effective prediction: comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929) |journal=Stat Med |volume=27 |issue=2 |pages=199–206 |year=2008 |month=January |pmid=17729377 |doi=10.1002/sim.2995 |url=http://dx.doi.org/10.1002/sim.2995 |issn=}}</ref> | |||
==Threats to validity of calculations== | ==Threats to validity of calculations== | ||
Revision as of 09:29, 17 December 2008
The sensitivity and specificity of diagnostic tests are based on Bayes Theorem and defined as "measures for assessing the results of diagnostic and screening tests. Sensitivity represents the proportion of truly diseased persons in a screened population who are identified as being diseased by the test. It is a measure of the probability of correctly diagnosing a condition. Specificity is the proportion of truly nondiseased persons who are so identified by the screening test. It is a measure of the probability of correctly identifying a nondiseased person. (From Last, Dictionary of Epidemiology, 2d ed)."[1]
Successful application of sensitivity and specificity is an important part of practicing evidence-based medicine.
Calculations
| Disease | ||||
|---|---|---|---|---|
| Present | Absent | |||
| Test result | Positive | Cell A | Cell B | Total with a positive test |
| Negative | Cell C | Cell D | Total with a negative test | |
| Total with disease | Total without disease | |||
Sensitivity and specificity
Predictive value of tests
The predictive values of diagnostic tests are defined as "in screening and diagnostic tests, the probability that a person with a positive test is a true positive (i.e., has the disease), is referred to as the predictive value of a positive test; whereas, the predictive value of a negative test is the probability that the person with a negative test does not have the disease. Predictive value is related to the sensitivity and specificity of the test."[2]
Summary statistics for diagnostic ability
While simply reporting the accuracy of a test seems intuitive, the accuracy is heavily influenced by the prevalence of disease.[3] For example, if the disease occurred with a a frequency of one in one thousand, then simply guessing that all patients do not have disease will yield an accuracy of over 99%.
Area under the ROC curve
The area under the receiver operating characteristic curve (ROC curve), or c-index has been proposed. The c-index varies from 0 to 1 and a result of 0.5 indicates that the diagnostic test does not add to guessing.[4] Variations have been proposed.[5][6]
Bayes Information Criterion
The Bayes Information Criterion has been proposed by Schwarz in 1978.[7]
Sum of sensitivity and specificity
This easy metric is called S+T.[8] It varies from 0 to 2 and a result of 1 indicates that the diagnostic test does not add to guessing.
Predictiveness curve
A graph of the predictiveness curve has been proposed.[9]
Proportionate reduction in uncertainty score
The proportionate reduction in uncertainty score (PRU) has been proposed.[10]
Integrated sensitivity and specificity
This measure has been proposed as an alternative to the area of the the receiver operating characteristic curve.[11]
Reclassification tables
This measure has been proposed as an alternative to the area of the the receiver operating characteristic curve.[11] This method allows calculating a 'reclassification index' or 'reclassification rate', or 'net reclassification improvement' (NRI)[11].
Sequential scoring
Sequential scoring has been proposed in order to isolate the effect of a new, expensive diagnostic test.[12]
Threats to validity of calculations
Various biases incurred during the study and analysis of a diagnostic tests can affect the validity of the calculations. An example is spectrum bias.
Poorly designed studies may overestimate the accuracy of a diagnostic test.[13]
References
- ↑ National Library of Mediicne. Sensitivity and specificity. Retrieved on 2007-12-09.
- ↑ National Library of Mediicne. Predictive value of tests. Retrieved on 2007-12-09.
- ↑ Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA (May 1982). "Evaluating the yield of medical tests". JAMA 247 (18): 2543–6. PMID 7069920. [e]
- ↑ Hanley JA, McNeil BJ (April 1982). "The meaning and use of the area under a receiver operating characteristic (ROC) curve". Radiology 143 (1): 29–36. PMID 7063747. [e]
- ↑ Walter SD (July 2005). "The partial area under the summary ROC curve". Stat Med 24 (13): 2025–40. DOI:10.1002/sim.2103. PMID 15900606. Research Blogging.
- ↑ Bangdiwala SI, Haedo AS, Natal ML, Villaveces A (September 2008). "The agreement chart as an alternative to the receiver-operating characteristic curve for diagnostic tests". J Clin Epidemiol 61 (9): 866–74. DOI:10.1016/j.jclinepi.2008.04.002. PMID 18687288. Research Blogging.
- ↑ Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics 6, 461–464. DOI:10.1214/aos/1176344136 Google Scholar
- ↑ Connell FA, Koepsell TD (May 1985). "Measures of gain in certainty from a diagnostic test". Am. J. Epidemiol. 121 (5): 744–53. PMID 4014166. [e]
- ↑ Pepe, Margaret S.; Ziding Feng, Ying Huang, Gary Longton, Ross Prentice, Ian M. Thompson, Yingye Zheng (2008-02-01). "Integrating the Predictiveness of a Marker with Its Performance as a Classifier". Am. J. Epidemiol. 167 (3): 362-368. DOI:10.1093/aje/kwm305. PMID 17982157. Retrieved on 2008-12-17. Research Blogging.
- ↑ Coulthard MG (May 2007). "Quantifying how tests reduce diagnostic uncertainty". Arch. Dis. Child. 92 (5): 404–8. DOI:10.1136/adc.2006.111633. PMID 17158858. Research Blogging.
- ↑ 11.0 11.1 11.2 Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS (January 2008). "Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond". Stat Med 27 (2): 157–72; discussion 207–12. DOI:10.1002/sim.2929. PMID 17569110. Research Blogging.
- ↑ Greenland S (January 2008). "The need for reorientation toward cost-effective prediction: comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929)". Stat Med 27 (2): 199–206. DOI:10.1002/sim.2995. PMID 17729377. Research Blogging.
- ↑ Lijmer JG, Mol BW, Heisterkamp S, et al (September 1999). "Empirical evidence of design-related bias in studies of diagnostic tests". JAMA 282 (11): 1061–6. PMID 10493205. [e]