How Are Standard-Maintaining Activities Based on Comparative Judgement Affected by Mismarking in the Script Evidence?

Autor/in	Williamson, Joanna
Titel	How Are Standard-Maintaining Activities Based on Comparative Judgement Affected by Mismarking in the Script Evidence?
Quelle	In: Research Matters, (2022) 33, (20 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1755-6031
Schlagwörter	Standards; Grading; Decision Making; Comparative Analysis; High Stakes Tests; Cutting Scores; Correlation; Evaluation Methods; English; Mathematics Tests; Sociology; Foreign Countries; United Kingdom + Suchen Sie Ihr Suchwort? Standard; Notengebung; Schulnote; Decision-making; Entscheidungsfindung; Korrelation; English language; Englisch; Soziologie; Ausland; Großbritannien
Abstract	Providing evidence that can inform awarding is an important application of Comparative Judgement (CJ) methods in high-stakes qualifications. The process of marking scripts is not changed, but CJ methods can assist in the maintenance of standards from one series to another by informing decisions about where to place grade boundaries or cut scores. The research described in this article set out to increase understanding of the risks associated with this use of CJ. Specifically, the research explored how robust the outcomes of CJ-based awarding activities would be to mismarking in the script evidence. In this article, the author explores the extent to which the simplified pairs (SP) method would be robust to mismarking in the sample of scripts used for the comparison exercise. The research has two main conclusions: (1) The SP method appears robust to single large marking errors and to fairly large marking errors in quite high proportions of sampled scripts; and (2) The SP method is more vulnerable to a general degradation of marking quality. (ERIC).
Anmerkungen	Cambridge University Press & Assessment. Shaftesbury Road Cambridge CB2 8EA. Tel: 44-1223-553311; e-mail: directcs@cambridge.org; Web site: https://www.cambridgeassessment.org.uk/our-research/all-published-resources/research-matters/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01