Literaturnachweis - Detailanzeige
Autor/inn/en | Yeadon, Will; Inyang, Oto-Obong; Mizouri, Arin; Peach, Alex; Testrow, Craig P. |
---|---|
Titel | The Death of the Short-Form Physics Essay in the Coming AI Revolution |
Quelle | In: Physics Education, 58 (2023) 3, Artikel 035027 (13 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Zusatzinformation | ORCID (Yeadon, Will) ORCID (Inyang, Oto-Obong) ORCID (Testrow, Craig P.) |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0031-9120 |
Schlagwörter | Artificial Intelligence; Physics; Essays; Science Instruction; College Science; Plagiarism; Fidelity; Grades (Scholastic); Evaluation; Foreign Countries; United Kingdom (England) |
Abstract | The latest AI language modules can produce original, high quality full short-form (300-word) Physics essays within seconds. These technologies such as ChatGPT and davinci-003 are freely available to anyone with an internet connection. In this work, we present evidence of AI generated short-form essays achieving First-Class grades on an essay writing assessment from an accredited, current university Physics module. The assessment requires students answer five open-ended questions with a short, 300-word essay each. Fifty AI answers were generated to create ten submissions that were independently marked by five separate markers. The AI generated submissions achieved an average mark of 71 ± 2%, in strong agreement with the current module average of 71 ± 5%. A typical AI submission would therefore most-likely be awarded a First Class, the highest classification available at UK universities. Plagiarism detection software returned a plagiarism score between 2 ± 1% (Grammarly) and 7 ± 2% (TurnitIn). We argue that these results indicate that current natural language processing AI represent a significant threat to the fidelity of short-form essays as an assessment method in Physics courses. (As Provided). |
Anmerkungen | IOP Publishing. 190 North Independence Mall West Suite 601, Philadelphia, PA 19106. Tel: 215-627-0880; Fax: 215-627-0879; e-mail: ped@ioppublishing.org; Web site: https://iopscience.iop.org/journal/0031-9120 |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2024/1/01 |