Modeling Slipping Effects in a Large-Scale Assessment with Innovative Item Formats

Autor/inn/en	Cuhadar, Ismail; Binici, Salih
Titel	Modeling Slipping Effects in a Large-Scale Assessment with Innovative Item Formats
Quelle	In: Educational Measurement: Issues and Practice, 41 (2022) 3, S.48-57 (10 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Cuhadar, Ismail)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12508
Schlagwörter	Item Response Theory; Measurement; Student Evaluation; Algebra; Test Items; Test Format; Bias; Ability; Simulation + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Messverfahren; Schulnote; Studentische Bewertung; Test content; Testaufgabe; Testentwicklung; Fähigkeit; Fertigkeit; Simulation program; Simulationsprogramm
Abstract	This study employs the 4-parameter logistic item response theory model to account for the unexpected incorrect responses or slipping effects observed in a large-scale Algebra 1 End-of-Course assessment, including several innovative item formats. It investigates whether modeling the misfit at the upper asymptote has any practical impact on the parameter estimates. With a simulation study, it also investigates the amount of bias in the parameter estimates when the slipping effects are ignored. Findings from the empirical data indicate that the impact of ignoring slipping effects is negligible when the abilities are evaluated within the context of classification of students into performance levels; however, it is present toward the extreme ends of ability continuum within the context of individual abilities. Findings from the simulations reveal that when the proportion of items with the slipping effects is small (20%), ignoring misfit does not have practical importance; however, when the proportion of items with the slipping effects is moderate to large (50%-80%), the abilities are generally underestimated at both ends of ability scale. When an upper asymptote parameter was used for modeling the slipping effects, the items became easier and more discriminative in general than the model ignoring the slipping effects. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01