Classification of Open-Ended Responses to a Research-Based Assessment Using Natural Language Processing

Autor/inn/en	Wilson, Joseph; Pollard, Benjamin; Aiken, John M.; Lewandowski, H. J.
Titel	Classification of Open-Ended Responses to a Research-Based Assessment Using Natural Language Processing
Quelle	In: Physical Review Physics Education Research, 18 (2022) 1, Artikel 010141 (16 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Wilson, Joseph) ORCID (Pollard, Benjamin) ORCID (Aiken, John M.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Natural Language Processing; Science Education; Physics; Artificial Intelligence; Models; Data Analysis; Classification; Student Reaction; Test Format; College Students; Colorado (Boulder) + Suchen Sie Ihr Suchwort? Natürliche Sprache; Naturwissenschaftliche Bildung; Physik; Künstliche Intelligenz; Analogiemodell; Auswertung; Classification system; Klassifikation; Klassifikationssystem; Schülerkritik; Testentwicklung; Collegestudent
Abstract	Surveys have long been used in physics education research to understand student reasoning and inform course improvements. However, to make analysis of large sets of responses practical, most surveys use a closed-response format with a small set of potential responses. Open-ended formats, such as written free response, can provide deeper insights into student thinking, but take much longer to analyze, especially with a large number of responses. Here, we explore natural language processing as a computational solution to this problem. We create a machine learning model that can take student responses from the Physics Measurement Questionnaire as input, and output a categorization of student reasoning based on different reasoning paradigms. Our model yields classifications with the same level of agreement as that between two humans categorizing the data, but can be done by a computer, and thus can be scaled for large datasets. In this work, we describe the algorithms and methodologies used to create, train, and test our natural language processing system. We also present the results of the analysis and discuss the utility of these approaches for analyzing open-response data in education research. (As Provided).
Anmerkungen	American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: http://prst-per.aps.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01