Proficiency Classification and Violated Local Independence: An Examination of Pass/Fail Decision Accuracy under Competing Rasch Models

Autor/inn/en	Hodge, Kari J.; Morgan, Grant B.
Titel	Proficiency Classification and Violated Local Independence: An Examination of Pass/Fail Decision Accuracy under Competing Rasch Models
Quelle	In: Journal of Applied Testing Technology, 21 (2020) 1, S.25-42 (18 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2375-5636
Schlagwörter	Item Response Theory; Accuracy; Decision Making; Classification; Comparative Analysis; Tests; International Assessment; Foreign Countries; Secondary School Students; Achievement Tests; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Item-Response-Theorie; Decision-making; Entscheidungsfindung; Classification system; Klassifikation; Klassifikationssystem; Examination; Prüfung; Examen; Ausland; Sekundarschüler; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen
Abstract	The purpose of this study was to examine the use of a misspecified calibration model and its impact on proficiency classification. Monte Carlo simulation methods were employed to compare competing models when the true structure of the data is known (i.e., testlet conditions). The conditions used in the design (e.g., number of items, testlet to item ratio, testlet variance, proportion of items that are testlet-based and sample size) reflect those found in the applied educational literature. Decision Consistency (DC) was high between the models, ranging from 91.5% to 100%. Testlet variance had the greatest effect on DC. An empirical example using PISA data with nine testlets is also provided for the consistency of pass/ fail decisions between the competing models. (As Provided).
Anmerkungen	Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building Suite 900, Washington DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: wgh.atp@att.net; Web site: http://www.testpublishers.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01