Literaturnachweis - Detailanzeige
Autor/inn/en | Black, Beth; Suto, Irenka; Bramley, Tom |
---|---|
Titel | The Interrelations of Features of Questions, Mark Schemes and Examinee Responses and Their Impact upon Marker Agreement |
Quelle | In: Assessment in Education: Principles, Policy & Practice, 18 (2011) 3, S.295-318 (24 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0969-594X |
Schlagwörter | Interrater Reliability; Grading; Scoring; High Stakes Tests; Test Items; Prediction; Influences; Models; Evidence; Exit Examinations; Foreign Countries; United Kingdom |
Abstract | In this paper we develop an evidence-based framework for considering many of the factors affecting marker agreement in GCSEs and A levels. A logical analysis of the demands of the marking task suggests a core grouping comprising: (i) question features; (ii) mark scheme features; and (iii) examinee response features. The framework synthesises several strands of previous empirical research. Additionally, we present new data, collected by observing the social dynamics of examiner meetings, to illustrate some effects of these interactions. We use our framework to argue that the two most important goals of research into marker agreement are "prediction" and "control." That is, assessment agencies need to be able not only to predict the level of agreement between a marker's mark and the "definitive" mark, but also to anticipate the effects of different possible courses of action on the level of agreement. We conclude with a list of possible courses of action, considering their effect not only on marking accuracy, but also on overall validity--the overriding concern. (Contains 3 tables and 5 figures.) (As Provided). |
Anmerkungen | Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2017/4/10 |