Evaluating Panelists' Understanding of Standard Setting Data

Autor/inn/en	Baron, Patricia; Sireci, Stephen G.; Slater, Sharon C.
Titel	Evaluating Panelists' Understanding of Standard Setting Data
Quelle	In: Educational Measurement: Issues and Practice, 40 (2021) 2, S.16-25 (10 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0731-1745
DOI	10.1111/emip.12399
Schlagwörter	State Standards; Standard Setting; Evaluators; Training; Data Interpretation; Alternative Assessment; Misconceptions; Evaluation Methods + Suchen Sie Ihr Suchwort? Standardisierung; Ausbildung; Data evaluation; Datenauswertung; Missverständnis
Abstract	Since the No Child Left Behind Act (No Child Left Behind [NCLB], 2001) was enacted, the Bookmark method has been used in many state standard setting studies (Karantonis and Sireci; Zieky, Perie, and Livingston). The purpose of the current study is to evaluate the criticism that when panelists are presented with data during the Bookmark standard setting process, these data are often misunderstood. We collected survey responses from eight panels of teachers who worked on an alternate assessment standard setting workshop. We found that although many panelists understood these data, others misunderstood them. For example, when panelists reviewed panel judgment statistics, some extrapolated beyond what these data represent. Our results include themes describing the types of misconceptions we observed, and the need for training and evaluation related to understanding and use of data used in standard setting. We share some suggestions for consideration when implementing the Bookmark method. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01