Combining Process Information and Item Response Modeling to Estimate Problem-Solving Ability

Autor/inn/en	Xiao, Yue; Veldkamp, Bernard; Liu, Hongyun
Titel	Combining Process Information and Item Response Modeling to Estimate Problem-Solving Ability
Quelle	In: Educational Measurement: Issues and Practice, 41 (2022) 2, S.36-54 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Xiao, Yue) ORCID (Veldkamp, Bernard) ORCID (Liu, Hongyun)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12474
Schlagwörter	Problem Solving; Item Response Theory; Scores; Item Analysis; Models; Correlation; Adults; Measurement; Program for the International Assessment of Adult Competencies (PIAAC) + Suchen Sie Ihr Suchwort? Problemlösen; Item-Response-Theorie; Itemanalyse; Analogiemodell; Korrelation; Messverfahren
Abstract	The action sequences of respondents in problem-solving tasks reflect rich and detailed information about their performance, including differences in problem-solving ability, even if item scores are equal. It is therefore not sufficient to infer individual problem-solving skills based solely on item scores. This study is a preliminary attempt to incorporate process data analysis into the measurement of problem-solving ability. The entire procedure consists of using information from process data as prior information for the estimation of problem-solving proficiency in an item response model. The purpose of this study is twofold: (1) to investigate the impact of adding process information on the estimation of latent ability; (2) to examine the extent to which the ability estimates obtained from the combination model can reflect the information of the problem-solving process. Seven problem-solving items from the Programme for International Assessment of Adult Competencies were used. Results indicate that the inclusion of process priors enhances the correlation between proficiency estimates and process information related to the problem-solving strategies adopted by respondents, as well as to their solution efficiency. The inclusion of process priors further reveals differences in the problem-solving performance of respondents exhibiting the same score pattern and increases precision of latent ability estimation. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2022/4/11