Poorly Performing Physicians: Does the Script Concordance Test Detect Bad Clinical Reasoning?

Autor/inn/en	Goulet, Francois; Jacques, Andre; Gagnon, Robert; Charlin, Bernard; Shabah, Abdo
Titel	Poorly Performing Physicians: Does the Script Concordance Test Detect Bad Clinical Reasoning?
Quelle	In: Journal of Continuing Education in the Health Professions, 30 (2010) 3, S.161-166 (6 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0894-1912
DOI	10.1002/chp.20076
Schlagwörter	Medical Education; Evaluators; Physicians; Family Practice (Medicine); Foreign Countries; Data Interpretation; Job Performance; Interviews; Peer Evaluation; Qualitative Research; Tests; Thinking Skills; Scores; Statistical Analysis; Canada + Suchen Sie Ihr Suchwort? Medizinische Ausbildung; Physician; Doctor; Arzt; Ausland; Data evaluation; Datenauswertung; Work performance; Arbeitsleistung; Interviewing; Interviewtechnik; Qualitative Forschung; Examination; Prüfung; Examen; Denkfähigkeit; Statistische Analyse; Kanada
Abstract	Introduction: Evaluation of poorly performing physicians is a worldwide concern for licensing bodies. The College des Medecins du Quebec currently assesses the clinical competence of physicians previously identified with potential clinical competence difficulties through a day-long procedure called the Structured Oral Interview (SOI). Two peer physicians produce a qualitative report. In view of remediation activities and the potential for legal consequences, more information on the clinical reasoning process (CRP) and quantitative data on the quality of that process is needed. This study examines the Script Concordance Test (SCT), a tool that provides a standardized and objective measure of a specific dimension of CRP, clinical data interpretation (CDI), to determine whether it could be useful in that endeavor. Methods: Over a 2-year period, 20 family physicians took, in addition to the SOI, a 1-hour paper-and-pencil SCT. Three evaluators, blind as to the purpose of the experiment, retrospectively reviewed SOI reports and were asked to estimate clinical reasoning quality. Subjects were classified into 2 groups (below and above median of the score distribution) for the 2 assessment methods. Agreement between classifications is estimated with the use of the Kappa coefficient. Results: Intraclass correlation for SOI was 0.89. Cronbach alpha coefficient for the SCT was 0.90. Agreement between methods was found for 13 participants (Kappa: 0.30, P = 0.18), but 7 out of 20 participants were classified differently in both methods. All participants but 1 had SCT scores below 2 SD of panel mean, thus indicating serious deficiencies in CDI. Discussion: The finding that the majority of the referred group did so poorly on CDI tasks has great interest for assessment as well as for remediation. In remediation of prescribing skills, adding SCT to SOI is useful for assessment of cognitive reasoning in poorly performing physicians. The structured oral interview should be improved with more precise reporting by those who assess the clinical reasoning process of examinees, and caution is recommended in interpreting SCT scores; they reflect only a part of the reasoning process. (Contains 2 figures.) (As Provided).
Anmerkungen	John Wiley & Sons, Inc. Subscription Department, 111 River Street, Hoboken, NJ 07030-5774. Tel: 800-825-7550; Tel: 201-748-6645; Fax: 201-748-6021; e-mail: subinfo@wiley.com; Web site: http://www3.interscience.wiley.com/browse/?type=JOURNAL
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10