A Study of Confidence and Accuracy Using the Rasch Modeling Procedures. Research Report. ETS RR-08-42

Autor/inn/en	Paek, Insu; Lee, Jihyun; Stankov, Lazar; Wilson, Mark
Titel	A Study of Confidence and Accuracy Using the Rasch Modeling Procedures. Research Report. ETS RR-08-42
Quelle	In: ETS Research Report Series, (2008), (33 Seiten)Infoseite zur Zeitschrift PDF als Volltext (1); PDF als Volltext kostenfreie Datei (2) Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2330-8516
DOI	10.1002/j.2333-8504.2008.tb02128.x
Schlagwörter	Self Esteem; Accuracy; Item Response Theory; English; Language Tests; Language Proficiency; Test Items; Difficulty Level; Test Wiseness; Psychometrics; Equations (Mathematics); Reading; Listening + Suchen Sie Ihr Suchwort? Self-esteem; Selbstaufmerksamkeit; Item-Response-Theorie; English language; Englisch; Language test; Sprachtest; Language skill; Language skills; Sprachkompetenz; Test content; Testaufgabe; Schwierigkeitsgrad; Psychometry; Psychometrie; Equations; Mathematics; Gleichungslehre; Leseprozess; Lesen; Hörvorgang; Zuhören
Abstract	This study investigated the relationship between students' actual performance (accuracy) and their subjective judgments of accuracy (confidence) on selected English language proficiency tests. The unidimensional and multidimensional IRT Rasch approaches were used to model the discrepancy between confidence and accuracy at the item and test level and to assess disattenuated strength of association between accuracy and confidence. The analysis results indicate a pattern of overconfidence bias (i.e., overestimation of success rate), which was related to item difficulty. In addition, the strength of association between accuracy and confidence dimension was relatively high: The confidence dimension explained 45% and 52% of the variability in the accuracy dimension for the two tests employed in this study. (As Provided).
Anmerkungen	Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01