A Nonparametric Approach to Estimate Classification Accuracy and Consistency

Autor/inn/en	Lathrop, Quinn N.; Cheng, Ying
Titel	A Nonparametric Approach to Estimate Classification Accuracy and Consistency
Quelle	In: Journal of Educational Measurement, 51 (2014) 3, S.318-334 (17 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12048
Schlagwörter	Cutting Scores; Classification; Computation; Nonparametric Statistics; Item Response Theory; Simulation; Test Length; Ability; Accuracy; Evaluation Methods + Suchen Sie Ihr Suchwort? Classification system; Klassifikation; Klassifikationssystem; Item-Response-Theorie; Simulation program; Simulationsprogramm; Fähigkeit; Fertigkeit
Abstract	When cut scores for classifications occur on the total score scale, popular methods for estimating classification accuracy (CA) and classification consistency (CC) require assumptions about a parametric form of the test scores or about a parametric response model, such as item response theory (IRT). This article develops an approach to estimate CA and CC nonparametrically by replacing the role of the parametric IRT model in Lee's classification indices with a modified version of Ramsay's kernel-smoothed item response functions. The performance of the nonparametric CA and CC indices are tested in simulation studies in various conditions with different generating IRT models, test lengths, and ability distributions. The nonparametric approach to CA often outperforms Lee's method and Livingston and Lewis's method, showing robustness to nonnormality in the simulated ability. The nonparametric CC index performs similarly to Lee's method and outperforms Livingston and Lewis's method when the ability distributions are nonnormal. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10