How Well Do Practicing Radiologists Interpret the Results of CAD Technology? A Quantitative Characterization

Autor/inn/en	Branch, Fallon; Williams, K. Matthew; Santana, Isabella Noel; Hegdé, Jay
Titel	How Well Do Practicing Radiologists Interpret the Results of CAD Technology? A Quantitative Characterization
Quelle	In: Cognitive Research: Principles and Implications, 7 (2022), Artikel 52 (12 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Branch, Fallon) ORCID (Hegdé, Jay)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2365-7464
DOI	10.1186/s41235-022-00375-9
Schlagwörter	Radiology; Allied Health Personnel; Assistive Technology; Clinical Diagnosis; Accuracy; Screening Tests; Test Interpretation; Probability; Cancer; Patients; Decision Making; Training; Computer Assisted Testing + Suchen Sie Ihr Suchwort? Radiologie; Screening-Verfahren; Test analysis; Testauswertung; Wahrscheinlichkeitsrechnung; Wahrscheinlichkeitstheorie; Carcinoma; Karzinom; Krebs (med); Krebserkrankung; Patient; Decision-making; Entscheidungsfindung; Ausbildung
Abstract	Many studies have shown that using a computer-aided detection (CAD) system does not significantly improve diagnostic accuracy in radiology, possibly because radiologists fail to interpret the CAD results properly. We tested this possibility using screening mammography as an illustrative example. We carried out two experiments, one using 28 practicing radiologists, and a second one using 25 non-professional subjects. During each trial, subjects were shown the following four pieces of information necessary for evaluating the actual probability of cancer in a given unseen mammogram: the binary decision of the CAD system as to whether the mammogram was positive for cancer, the true-positive and false-positive rates of the system, and the prevalence of breast cancer in the relevant patient population. Based only on this information, the subjects had to estimate the probability that the unseen mammogram in question was positive for cancer. Additionally, the non-professional subjects also had to decide, based on the same information, whether to recall the patients for additional testing. Both groups of subjects similarly (and significantly) overestimated the cancer probability regardless of the categorical CAD decision, suggesting that this effect is not peculiar to either group. The misestimations were not fully attributable to causes well-known in other contexts, such as base rate neglect or inverse fallacy. Non-professional subjects tended to recall the patients at high rates, even when the actual probably of cancer was at or near zero. Moreover, the recall rates closely reflected the subjects' estimations of cancer probability. Together, our results show that subjects interpret CAD system output poorly when only the probabilistic information about the underlying decision parameters is available to them. Our results also highlight the need for making the output of CAD systems more readily interpretable, and for providing training and assistance to radiologists in evaluating the output. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01