Literaturnachweis - Detailanzeige
Autor/inn/en | Hecht, Martin; Weirich, Sebastian; Siegle, Thilo; Frey, Andreas |
---|---|
Titel | Effects of Design Properties on Parameter Estimation in Large-Scale Assessments |
Quelle | In: Educational and Psychological Measurement, 75 (2015) 6, S.1021-1044 (24 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 0013-1644 |
DOI | 10.1177/0013164415573311 |
Schlagwörter | Measurement; Computation; Test Format; Test Items; Test Bias; Item Response Theory; Grade 9; Science Tests; Achievement Tests; Simulation; Hierarchical Linear Modeling; Foreign Countries; Germany Messverfahren; Testentwicklung; Test content; Testaufgabe; Testkritik; Item-Response-Theorie; School year 09; 9. Schuljahr; Schuljahr 09; Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Simulation program; Simulationsprogramm; Ausland; Deutschland |
Abstract | The selection of an appropriate booklet design is an important element of large-scale assessments of student achievement. Two design properties that are typically optimized are the "balance" with respect to the positions the items are presented and with respect to the mutual occurrence of pairs of items in the same booklet. The purpose of this study is to investigate the effects of these two design properties on bias and root mean square error of item parameter estimates from the Rasch model. First, position effects are estimated using data from a large-scale assessment study measuring the competencies of 19,107 ninth graders in science. These results were then used for a simulation study with 1,540 booklet designs with systematically varied position balance and cluster pair balance. The simulation results showed a small effect of position balancing on bias and root mean square error of the item parameter estimates while the cluster pair balance was ignorable. This null effect is actually good news for test designers since it allows for deliberately reducing the degree of cluster pair balance without negative effects on item parameter estimates. However, it is recommended to try to achieve a high position balance when designing large-scale assessment studies. (As Provided). |
Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2020/1/01 |