Generation of Multiple-Choice Questions From Textbook Contents of School-Level Subjects

Autor/inn/en	C. H., Dhawaleswar Rao; Saha, Sujan Kumar
Titel	Generation of Multiple-Choice Questions From Textbook Contents of School-Level Subjects
Quelle	In: IEEE Transactions on Learning Technologies, 16 (2023) 1, S.40-52 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (C. H., Dhawaleswar Rao) ORCID (Saha, Sujan Kumar)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
DOI	10.1109/TLT.2022.3224232
Schlagwörter	Multiple Choice Tests; Computer Assisted Testing; Automation; Test Items; Textbooks; Middle School Students; Student Evaluation; Sentences; Syntax; Semantics; Natural Language Processing; Foreign Countries; India + Suchen Sie Ihr Suchwort? Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Test content; Testaufgabe; Textbook; Text book; Schulbuch; Lehrbuch; Middle school; Middle schools; Student; Students; Mittelschule; Mittelstufenschule; Schüler; Schülerin; Schulnote; Studentische Bewertung; Sentence analysis; Satzanalyse; Semantik; Natürliche Sprache; Ausland; Indien
Abstract	Multiple-choice question (MCQ) plays a significant role in educational assessment. Automatic MCQ generation has been an active research area for years, and many systems have been developed for MCQ generation. Still, we could not find any system that generates accurate MCQs from school-level textbook contents that are useful in real examinations. This observation motivated us to develop a system that generates MCQs to assess the student's recall of factual information. Also, the available systems are often domain, subject, or application-specific in nature. Although the MCQ generation task demands a specific setup, we expect a level of generalization can be achieved. In this development, we also focus on this issue. We propose a pipeline for automatic generation of MCQs from textbooks of middle-school level subjects, and the pipeline is partially subject-independent. The proposed pipeline comprises four core modules: preprocessing, sentence selection, key selection, and distractor generation. Several techniques have been employed to implement individual modules. These include sentence simplification, syntactic and semantic processing of the sentences, entity recognition, semantic relationship extraction among entities, WordNet, neural word embedding, neural sentence embedding, and computation of intersentence similarity. The system is evaluated using the National Council of Educational Research and Training (NCERT), India, textbooks for three subjects. The quality of system-generated questions is assessed by human experts using various system-level and individual module-level metrics. The experimental results demonstrate that the proposed system is capable of generating quality questions that could be useful in a real examination. (As Provided).
Anmerkungen	Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01