Using Cultural Historical Activity Theory to Reflect on the Sociocultural Complexities in OSCE Examiners' Judgements

Autor/inn/en	Wong, Wai Yee Amy; Thistlethwaite, Jill; Moni, Karen; Roberts, Chris
Titel	Using Cultural Historical Activity Theory to Reflect on the Sociocultural Complexities in OSCE Examiners' Judgements
Quelle	In: Advances in Health Sciences Education, 28 (2023) 1, S.27-46 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wong, Wai Yee Amy) ORCID (Thistlethwaite, Jill) ORCID (Moni, Karen) ORCID (Roberts, Chris)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1382-4996
DOI	10.1007/s10459-022-10139-1
Schlagwörter	Sociocultural Patterns; Evaluators; Performance Based Assessment; Accountability; Medical Students; Medical Education; Student Evaluation; High Stakes Tests; Evaluation Methods; Foreign Countries; Learning Theories; Evaluation Criteria; Australia + Suchen Sie Ihr Suchwort? Soziokulturelle Theorie; Leistungsermittlung; Verantwortung; Medizinische Ausbildung; Schulnote; Studentische Bewertung; Ausland; Learning theory; Lerntheorie; Australien
Abstract	Examiners' judgements play a critical role in competency-based assessments such as objective structured clinical examinations (OSCEs). The standardised nature of OSCEs and their alignment with regulatory accountability assure their wide use as high-stakes assessment in medical education. Research into examiner behaviours has predominantly explored the desirable psychometric characteristics of OSCEs, or investigated examiners' judgements from a cognitive rather than a sociocultural perspective. This study applies cultural historical activity theory (CHAT) to address this gap in exploring examiners' judgements in a high-stakes OSCE. Based on the idea that OSCE examiners' judgements are socially constructed and mediated by their clinical roles, the objective was to explore the sociocultural factors that influenced examiners' judgements of student competence and use the findings to inform examiner training to enhance assessment practice. Seventeen semi-structured interviews were conducted with examiners who assessed medical student competence in progressing to the next stage of training in a large-scale OSCE at one Australian university. The initial thematic analysis provided a basis for applying CHAT iteratively to explore the sociocultural factors and, specifically, the contradictions created by interactions between different elements such as examiners and rules, thus highlighting the factors influencing examiners' judgements. The findings indicated four key factors that influenced examiners' judgements: examiners' contrasting beliefs about the purpose of the OSCE; their varying perceptions of the marking criteria; divergent expectations of student competence; and idiosyncratic judgement practices. These factors were interrelated with the activity systems of the medical school's assessment practices and the examiners' clinical work contexts. Contradictions were identified through the guiding principles of multi-voicedness and historicity. The exploration of the sociocultural factors that may influence the consistency of examiners' judgements was facilitated by applying CHAT as an analytical framework. Reflecting upon these factors at organisational and system levels generated insights for creating fit-for-purpose examiner training to enhance assessment practice. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01