Can Software Improve Marker Accuracy at Detecting Contract Cheating? A Pilot Study of the Turnitin Authorship Investigate Alpha

Autor/inn/en	Dawson, Phillip; Sutherland-Smith, Wendy; Ricksen, Mark
Titel	Can Software Improve Marker Accuracy at Detecting Contract Cheating? A Pilot Study of the Turnitin Authorship Investigate Alpha
Quelle	In: Assessment & Evaluation in Higher Education, 45 (2020) 4, S.473-482 (10 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Dawson, Phillip) ORCID (Sutherland-Smith, Wendy)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0260-2938
DOI	10.1080/02602938.2019.1662884
Schlagwörter	Cheating; Identification; Accuracy; Computer Software; Writing Assignments; Integrity; Educational Technology; Undergraduate Students + Suchen Sie Ihr Suchwort? Prellen; Identifikation; Identifizierung; Integrität; Unterrichtsmedien
Abstract	Contract cheating happens when students outsource their assessed work to a third party. One approach that has been suggested for improving contract cheating detection is comparing students' assignment submissions with their previous work, the rationale being that changes in style may indicate a piece of work has been written by somebody else. This approach is time consuming, but recent advances in machine learning and natural language processing suggest that it may be well suited to computerization. We trialed an early alpha version of Turnitin's Authorship Investigate tool, which compares students' submissions against their previous work. Twenty-four experienced markers from five units of study were asked to make decisions about the presence of contract cheating in bundles of 20 student assignments, which included 14 legitimate assignments and six purchased from contract cheating sites. We asked markers to determine if each assignment was contract cheating, then provided them with an Authorship Investigate report and let them change their decision. Marker accuracy at detecting contract cheating increased significantly, from 48% to 59% after using the report, with no significant difference in false positives. These findings suggest that software may be an effective component of institutional strategies to address contract cheating. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01