A New Facets Model for Rater's Centrality/Extremity Response Style

Autor/inn/en	Jin, Kuan-Yu; Wang, Wen-Chung
Titel	A New Facets Model for Rater's Centrality/Extremity Response Style
Quelle	In: Journal of Educational Measurement, 55 (2018) 4, S.543-563 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0022-0655
DOI	10.1111/jedm.12191
Schlagwörter	Scoring; Models; Interrater Reliability; Computation; Raw Scores + Suchen Sie Ihr Suchwort? Bewertung; Analogiemodell; Interrater-Reliabilität
Abstract	The Rasch facets model was developed to account for facet data, such as student essays graded by raters, but it accounts for only one kind of rater effect (severity). In practice, raters may exhibit various tendencies such as using middle or extreme scores in their ratings, which is referred to as the rater centrality/extremity response style. To achieve better measurement quality in rater data, it is desirable to simultaneously consider both rater severity and rater centrality/extremity. A new facets model is thus developed by adding to the Rasch facets model a weight parameter for the item thresholds for each rater. The parameters of the new facets model can be estimated with the JAGS freeware. An empirical example is provided to illustrate the implications and applications of the new model. Two simulation studies were conducted. The first simulation was to evaluate the parameter recovery of the new facets model and the consequences of ignoring the effects of rater centrality/extremity on parameter estimation. The second simulation was to illustrate how rater severity affects the relationship between rater centrality and the standard deviation of raw rating scores. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01