An Experimental Study of the Effect of Judges' Knowledge of Item Data on Two Forms of the Angoff Standard Setting Method.

Autor/inn/en	Garrido, Mariquita; Payne, David A.
Titel	An Experimental Study of the Effect of Judges' Knowledge of Item Data on Two Forms of the Angoff Standard Setting Method.
Quelle	(1987), (15 Seiten)Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; Monographie
Schlagwörter	Academic Standards; Comparative Analysis; Criterion Referenced Tests; Cutting Scores; Difficulty Level; Higher Education; Interrater Reliability; Judges; Minimum Competency Testing; Multiple Choice Tests; Standard Setting (Scoring); Statistical Distributions; Statistics; Test Items; Test Theory + Suchen Sie Ihr Suchwort? Schwierigkeitsgrad; Hochschulbildung; Hochschulsystem; Hochschulwesen; Interrater-Reliabilität; Judge; Richter; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Bewertungsskala; Wahrscheinlichkeitsverteilung; Statistik; Test content; Testaufgabe; Testtheorie
Abstract	Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent, whereas the Modified Angoff method used a seven point scale (5, 20, 40, 60, 75, 90, 95). Item data were in the form of frequency distributions of multiple-choice exam option selections for five student ability levels. Results indicated significantly: (1) greater intra-judge variability for the Angoff method; and (2) higher minimum competency cut-off scores for judges with performance data available for reference than for judges who did not have data available. Acceptable levels of inter-judge reliability, judge internal consistency, and item internal consistency were also observed. (Author)
Erfasst von	ERIC (Education Resources Information Center), Washington, DC