Exploring Confidence Accuracy and Item Difficulty in Changing Multiple-Choice Answers of Scientific Reasoning Test

Autor/inn/en	Fadillah, Sarah Meilani; Ha, Minsu; Nuraeni, Eni; Indriyanti, Nurma Yunita
Titel	Exploring Confidence Accuracy and Item Difficulty in Changing Multiple-Choice Answers of Scientific Reasoning Test
Quelle	In: Malaysian Journal of Learning and Instruction, 20 (2023) 2, S.319-341 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Zusatzinformation	ORCID (Fadillah, Sarah Meilani) ORCID (Indriyanti, Nurma Yunita)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1675-8110
Schlagwörter	Science Tests; Multiple Choice Tests; Test Items; Decision Making; Difficulty Level; Psychometrics; Undergraduate Students; Computer Assisted Testing; Test Format; Foreign Countries; Classification; Self Esteem; Thinking Skills; Item Response Theory; Accuracy; Indonesia + Suchen Sie Ihr Suchwort? Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Test content; Testaufgabe; Decision-making; Entscheidungsfindung; Schwierigkeitsgrad; Psychometry; Psychometrie; Testentwicklung; Ausland; Classification system; Klassifikation; Klassifikationssystem; Self-esteem; Selbstaufmerksamkeit; Denkfähigkeit; Item-Response-Theorie; Indonesien
Abstract	Purpose: Researchers discovered that when students were given the opportunity to change their answers, a majority changed their responses from incorrect to correct, and this change often increased the overall test results. What prompts students to modify their answers? This study aims to examine the modification of scientific reasoning test, with additional exploration on confidence accuracy and its relation to item difficulty. Methodology: A set of pre-test and post-test experiments which included 20 items of scientific reasoning test with confidence judgement on each item were used. The items of the instruments were assessed for their validity by analysing their psychometric properties using the three-parameter (3PL) Item Response Theory, which was carried out in R studio. The set of items were randomly administered to 205 Indonesian undergraduate students with a background in science education related major. The accuracy of confidence was determined by categorising correct or incorrect answers to scientific reasoning questions based on their level of confidence. Findings: The results revealed that responses were modified more frequently from incorrect to correct than from correct to incorrect, resulting in a significant gain in overall scientific reasoning score although these modifications were not shown to be connected to the item's difficulty level. Even though confidence level also increased significantly, it was observed that Indonesian students repeatedly responded with overconfidence even after sitting for the same test after three weeks, which could indicate a lack of metacognitive ability. The findings of this study serve to spur educators to begin actively engaging in metacognitive training in their teaching and learning activities as a result of overconfidence that frequently occurs among Indonesian students in examinations. Significance: This study provides further substantiation in the field of scientific reasoning and cognitive science; that a trend of confidence accuracy change in scientific reasoning test has been observed. It also contributes to uncovering the true ability of Indonesian students when performing such reasoning tests through their repeated attempts. (As Provided).
Anmerkungen	Universiti Utara Malaysia Press. UUM Press, Universiti Utara Malaysia, 08010 UUM Sintok, Kedah, Malaysia. Tel: +60-4-928-4816; Fax: +60-4-928-4792; e-mail: uumpress@uum.edu.my; Web site: https://e-journal.uum.edu.my/index.php/mjli
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01