Maintaining Score Scales over Time: A Comparison of Five Scoring Methods

Autor/inn/en	Kim, Stella Yun; Lee, Won-Chan
Titel	Maintaining Score Scales over Time: A Comparison of Five Scoring Methods
Quelle	In: Applied Measurement in Education, 36 (2023) 1, S.60-79 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Kim, Stella Yun)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2023.2172015
Schlagwörter	Scoring; Comparative Analysis; Item Response Theory; Simulation; Bayesian Statistics; Probability; Test Items; Evaluation Criteria; Standards; Scaling; Error of Measurement; Statistical Bias + Suchen Sie Ihr Suchwort? Bewertung; Item-Response-Theorie; Simulation program; Simulationsprogramm; Wahrscheinlichkeitsrechnung; Wahrscheinlichkeitstheorie; Test content; Testaufgabe; Standard; Scale construction; Skalenkonstruktion; Messfehler
Abstract	This study evaluates various scoring methods including number-correct scoring, IRT theta scoring, and hybrid scoring in terms of scale-score stability over time. A simulation study was conducted to examine the relative performance of five scoring methods in terms of preserving the first two moments of scale scores for a population in a chain of linking with multiple test forms. Simulation factors included 1) the number of forms linked back to the initial form, 2) the pattern in mean shift, and 3) the proportion of common items. Results showed that scoring methods that operate with number-correct scores generally outperform those that are based on IRT proficiency estimators ([theta]) in terms of reproducing the mean and standard deviation of scale scores. Scoring methods performed differently as a function of patterns in a group proficiency change. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01