Research Project Assessments and Supervisor Marking: Maintaining Academic Rigour through Robust Reconciliation Processes

Autor/inn/en	McQuade, Richard; Kometa, Simon; Brown, Jeremy; Bevitt, Debra; Hall, Judith
Titel	Research Project Assessments and Supervisor Marking: Maintaining Academic Rigour through Robust Reconciliation Processes
Quelle	In: Assessment & Evaluation in Higher Education, 45 (2020) 8, S.1181-1191 (11 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (McQuade, Richard) ORCID (Bevitt, Debra) ORCID (Hall, Judith)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0260-2938
DOI	10.1080/02602938.2020.1726284
Schlagwörter	Foreign Countries; Research Projects; Student Research; Supervisors; Grading; Undergraduate Students; Biological Sciences; College Science; Bias; Capstone Experiences; Research Reports; Interrater Reliability; United Kingdom + Suchen Sie Ihr Suchwort? Ausland; Forschungsvorhaben; Studentenforschung; Notengebung; Schulnote; Abwasserbiologie; Research report; Forschungsbericht; Interrater-Reliabilität; Großbritannien
Abstract	Research project modules are a key part of UK undergraduate and postgraduate bioscience degree programmes. Report marking invariably uses two assessors, but marking models are mixed with some institutions using two independent markers and others using the project supervisor as one of the assessors. This latter model is controversial with critics suggesting that it is vulnerable to supervisor bias whilst proponents argue that it ensures subject expertise in the assessment process. Our undergraduate bioscience programmes utilise the supervisor as one of the report assessors, whilst postgraduate programmes do not. With the aim of exploring the impacts, if any, of using the supervisor as an assessor, the grades relating to undergraduate and postgraduate reports marked and reconciled during the period 2011/12 to 2016/17 were compared. Analyses of undergraduate reports (897), showed the grades awarded by the supervisor were on average 2.3% higher (p < 0.01) than those awarded by the independent assessor, although 22.8% of report grades differed by 10% and required reconciliation. After reconciliation the supervisor grades were an average of 1.3% higher (p < 0.01). Evaluation of postgraduate reports (894) showed grades awarded by 'home' assessors were on average 1.0% higher (p < 0.05) than the grades awarded by assessors from other universities, but 33.1% of the report grades differed by 10%. Following their reconciliation the average difference was 0.4%. Modification of the undergraduate reconciliation process so the two assessors agreed a single grade resulted in an average 0.5% difference (p < 0.05; Cohen's d value 0.1), which supported minimal supervisor bias and defended supervisor involvement as a project report marker. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01