Student-Group Item Parameter Drift Impact on Individual and Aggregate Observed Scores

Autor/in	Hess, Jessica
Titel	Student-Group Item Parameter Drift Impact on Individual and Aggregate Observed Scores
Quelle	(2023), (107 Seiten) PDF als Volltext Verfügbarkeit Ph.D. Dissertation, University of Kansas
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
ISBN	979-8-3797-0759-0
Schlagwörter	Hochschulschrift; Dissertation; Test Items; Groups; Ability; Item Response Theory; Bias; Classification; Computation; Scores + Suchen Sie Ihr Suchwort? Thesis; Dissertations; Academic thesis; Test content; Testaufgabe; Fähigkeit; Fertigkeit; Item-Response-Theorie; Classification system; Klassifikation; Klassifikationssystem
Abstract	This study was conducted to further research into the impact of student-group item parameter drift (SIPD) --referred to as subpopulation item parameter drift in previous research-- on ability estimates and proficiency classification accuracy when occurring in the discrimination parameter of a 2-PL item response theory (IRT) model. Using Monte Carlo simulation, several factors were manipulated and examined for impact including (1) direction of drift within the discrimination parameter, (2) true ability of student-groups, and (3) relative size of student-groups. ANOVA, including main effects and interaction effects, is used to evaluate bias in individual ability estimates, aggregate ability estimates, bias in percent proficient, and change in percent proficient. Results indicated that SIPD occurring in the discrimination parameter does impact bias in several ways; most substantially in percent proficient classification accuracy but less substantially on individual and aggregate ability estimates. Together, with findings from previous research about the impact of this phenomenon in the difficulty parameter, SIPD should be a concern for state level assessment and accountability decision makers as it has the potential to lead to inaccurate decisions regarding student performance. Suggestions for next steps when SIPD is suspected are provided. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.] (As Provided).
Anmerkungen	ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01