Script Concordance Testing: More Cases or More Questions?

Autor/inn/en	Gagnon, Robert; Charlin, Bernard; Lambert, Carole; Carriere, Benoit; Van der Vleuten, C.
Titel	Script Concordance Testing: More Cases or More Questions?
Quelle	In: Advances in Health Sciences Education, 14 (2009) 3, S.367-375 (9 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1382-4996
DOI	10.1007/s10459-008-9120-8
Schlagwörter	Generalizability Theory; Evaluation Methods; Generalization; Knowledge Level; Data Analysis; Case Studies; Decision Making; Problem Solving; Cognitive Psychology + Suchen Sie Ihr Suchwort? Wissensbasis; Auswertung; Case study; Fallstudie; Case Study; Decision-making; Entscheidungsfindung; Problemlösen; Kognitive Psychologie
Abstract	Script concordance test (SCT) is a case based assessment format of clinical reasoning in which questions are nested into several cases. Recent results using Q4 format suggest that nested questions contribute more to reliability of measure than cases. The present study aims at documenting variance components associated with SCT cases and nested questions and to determine what are the optimal number and combinations of cases and nested questions. Data from SCT in three different fields are presented. G study and D study methodology are used to estimate variance component and to determine optimal number and combinations of cases and questions. Questions nested into cases contributed a large amount of score variance (more than 70%). D studies with varying samples show that, depending on the reliability of the test, an optimal number of 2-4 questions nested into 15-25 cases represents the best combination. Nested questions contribute to a significant portion of score variance, with the implication that formulation of up to 5 questions per case is an efficient way to optimize the reliability of SCT scores. (As Provided).
Anmerkungen	Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10