Are Specialist Certification Examinations a Reliable Measure of Physician Competence?

Autor/inn/en	Burch, V. C.; Norman, G. R.; Schmidt, H. G.; van der Vleuten, C. P. M.
Titel	Are Specialist Certification Examinations a Reliable Measure of Physician Competence?
Quelle	In: Advances in Health Sciences Education, 13 (2008) 4, S.521-533 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1382-4996
DOI	10.1007/s10459-007-9063-5
Schlagwörter	Generalizability Theory; Physicians; Foreign Countries; Specialists; Certification; Licensing Examinations (Professions); High Stakes Tests; Reliability; South Africa + Suchen Sie Ihr Suchwort? Physician; Doctor; Arzt; Ausland; Abschlusszeugnis; Zertifizierung; Reliabilität; Südafrika; Süd-Afrika; Republik Südafrika; Südafrikanische Republik
Abstract	High stakes postgraduate specialist certification examinations have considerable implications for the future careers of examinees. Medical colleges and professional boards have a social and professional responsibility to ensure their fitness for purpose. To date there is a paucity of published data about the reliability of specialist certification examinations and objective methods for improvement. Such data are needed to improve current assessment practices and sustain the international credibility of specialist certification processes. To determine the component and composite reliability of the Fellowship examination of the College of Physicians of South Africa, and identify strategies for further improvement, generalizability and multivariate generalizability theory were used to estimate the reliability of examination subcomponents and the overall reliability of the composite examination. Decision studies were used to identify strategies for improving the composition of the examination. Reliability coefficients of the component subtests ranged from 0.58 to 0.64. The composite reliability of the examination was 0.72. This could be increased to 0.8 by weighting all test components equally or increasing the number of patient encounters in the clinical component of the examination. Correlations between examination components were high, suggesting that similar parameters of competence were being assessed. This composite certification examination, if equally weighted, achieved an overall reliability sufficient for high stakes examination purposes. Increasing the weighting of the clinical component decreased the reliability. This could be rectified by increasing the number of patient encounters in the examination. Practical ways of achieving this are suggested. (As Provided).
Anmerkungen	Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10