An Exploration of the Examination Script Features that Most Influence Expert Judgements in Three Methods of Evaluating Script Quality

Autor/inn/en	Suto, Irenka; Novakovic, Nadezda
Titel	An Exploration of the Examination Script Features that Most Influence Expert Judgements in Three Methods of Evaluating Script Quality
Quelle	In: Assessment in Education: Principles, Policy & Practice, 19 (2012) 3, S.301-320 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0969-594X
DOI	10.1080/0969594X.2011.592971
Schlagwörter	Examiners; Matched Groups; Grades (Scholastic); Grading; Evaluation Criteria; Evaluation Methods; Achievement Tests; Handwriting; Geometric Concepts; Biology; English; Regression (Statistics); Comprehension; Student Evaluation; Scores; Comparative Analysis; United Kingdom (England) + Suchen Sie Ihr Suchwort? Examiner; Prüfer; Notenspiegel; Notengebung; Schulnote; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Handschrift; Elementare Geometrie; Biologie; English language; Englisch; Regression; Regressionsanalyse; Verstehen; Verständnis; Studentische Bewertung
Abstract	Some methods of determining grade boundaries within examinations, such as awarding, paired comparisons, and rank ordering, entail expert judgements of script quality. We aimed to identify the features of examinees' scripts that most influence judgements in the three methods. For contrasting examinations in biology and English, a Latin square design enabled each of three matched groups of 10 experienced examiners to use each method to determine grade boundaries in an experimental setting. Additionally, every script was rated separately for nine potentially influential features by at least two examiners working independently. All three methods generated plausible grade boundary marks. The most influential features were inferred from analyses of the relationships between script feature ratings and grading judgements. Although the three methods yielded similarities and variations in the most influential features, no influential features were deemed likely to compromise the methods' validities. (Contains 5 tables, 2 figures and 1 note.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10