Assessing the Impact of Multidimensionality on the Classification Decisions of an IRT-Based Licensure Examination.

Autor/inn/en	Sykes, Robert C.; und weitere
Titel	Assessing the Impact of Multidimensionality on the Classification Decisions of an IRT-Based Licensure Examination.
Quelle	(1992), (27 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Classification; Comparative Testing; Computer Simulation; Decision Making; Failure; Higher Education; Item Response Theory; Licensing Examinations (Professions); Pass Fail Grading; Scores; Test Format + Suchen Sie Ihr Suchwort? Classification system; Klassifikation; Klassifikationssystem; Computergrafik; Computersimulation; Decision-making; Entscheidungsfindung; Hochschulbildung; Hochschulsystem; Hochschulwesen; Item-Response-Theorie; Testentwicklung
Abstract	A part-form methodology was used to study the effect of varying degrees of multidimensionality on the consistency of pass/fail classification decisions obtained from simulated unidimensional item response theory (IRT) based licensure examinations. A control on the degree of form multidimensionality permitted an assessment throughout the range of multidimensionality of any potential effect on Rasch item parameters and pass/fail classifications obtained from scores derived from them. Four full-length (300-item) forms of a licensure examination produced by CTB Macmillan/McGraw Hill were used to generate part-forms for four administrations in the summer of 1988, winter of 1989, summer of 1989, and winter of 1990, respectively. There were 2,000 examinees for each form. All four full-length forms had been demonstrated to be multidimensional, but could be made unidimensional by deleting no more than half the items with the largest absolute loadings on the second factor. Overall, failure concordance percentages did not differ between those pairs of part-forms that differed maximally in the degree of predicted multidimensionality and those pairs of part-forms where members were both predicted to be multidimensional. Results suggest that increased multidimensionality had no substantial effect on failure decision agreement. However, the failure concordance percentages for pairs of part-forms that were both most likely unidimensional were slightly higher than those for other pairs of part-forms. Four tables, 1 figure of study data and 12 references are included. (SLD)
Erfasst von	ERIC (Education Resources Information Center), Washington, DC