Literaturnachweis - Detailanzeige
Autor/inn/en | Cook, David A.; Beckman, Thomas J. |
---|---|
Titel | Does Scale Length Matter? A Comparison of Nine- versus Five-Point Rating Scales for the Mini-CEX |
Quelle | In: Advances in Health Sciences Education, 14 (2009) 5, S.655-664 (10 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 1382-4996 |
DOI | 10.1007/s10459-008-9147-x |
Schlagwörter | Interrater Reliability; Rating Scales; Internal Medicine; Test Validity; Video Technology; Medical Students; Medical Education; Educational Assessment; Measures (Individuals); Measurement Techniques; Evaluation Methods; Clinical Teaching (Health Professions); Medical School Faculty; Medical Evaluation; Student Evaluation; Graduate Students |
Abstract | Educators must often decide how many points to use in a rating scale. No studies have compared interrater reliability for different-length scales, and few have evaluated accuracy. This study sought to evaluate the interrater reliability and accuracy of mini-clinical evaluation exercise (mini-CEX) scores, comparing the traditional mini-CEX nine-point scale to a five-point scale. Methods: The authors conducted a validity study in an academic internal medicine residency program. Fifty-two program faculty participated. Participants rated videotaped resident-patient encounters using the mini-CEX with both a nine-point scale and a five-point scale. Some cases were scripted to reflect a specific level of competence (unsatisfactory, satisfactory, superior). Outcome measures included mini-CEX scores, accuracy (scores compared to scripted competence level), interrater reliability, and domain intercorrelation. Results: Interviewing, exam, counseling, and overall ratings varied significantly across levels of competence (P less than 0.0001). Nine-point scale scores accurately classified competence more often (391/720 [54%] for overall ratings) than five-point scores (316/723 [44%], P less than 0.0001). Interrater reliability was similar for scores from the nine- and five-point scales (0.43 and 0.40, respectively, for overall ratings). With the exception of correlation between exam and counseling scores using the five-point scale (r = 0.38, P = 0.13), score correlations among all domain combinations were high (r = 0.46-0.89) and statistically significant (P [less than or equal to] 0.015) for both scales. Conclusions: Mini-CEX scores demonstrated modest interrater reliability and accuracy. Although interrater reliability is similar for nine- and five-point scales, nine-point scales appear to provide more accurate scores. This has implications for many educational assessments. (As Provided). |
Anmerkungen | Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2017/4/10 |