Development and Use of Anchoring Vignettes: Psychometric Investigations and Recommendations for a Nonparametric Approach

Autor/inn/en	Lee, HyeSun; Smith, Weldon; Martinez, Angel; Ferris, Heather; Bova, Joe
Titel	Development and Use of Anchoring Vignettes: Psychometric Investigations and Recommendations for a Nonparametric Approach
Quelle	In: Applied Measurement in Education, 34 (2021) 3, S.204-222 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2021.1933983
Schlagwörter	Vignettes; Test Items; Equated Scores; Nonparametric Statistics; Accuracy; Response Style (Tests); Cross Cultural Studies; International Assessment; High School Students; California; Program for International Student Assessment + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Antwortverhalten; Cultural comparison; Kulturvergleich; High school; High schools; Student; Students; Oberschule; Schüler; Schülerin; Studentin; Kalifornien
Abstract	The aim of the current research was to provide recommendations to facilitate the development and use of anchoring vignettes (AVs) for cross-cultural comparisons in education. Study 1 identified six factors leading to order violations and ties in AV responses based on cognitive interviews with 15-year-old students. The factors were categorized into three domains: varying levels of AV format familiarity, differential interpretations of content, and individual differences in processing information. To inform the most appropriate approach to treat order violations and re-scaling method, Study 2 conducted Monte Carlo simulations with the manipulation of three factors and incorporation of five responses styles. Study 2 found that the AV approach improved accuracy in score estimation by successfully controlling for response styles. The results also revealed the reordering approach to treat order violations produced the most accurate estimation combined with the re-scaling method assigning the middle value among possible scores. Along with strategies to develop AVs, strengths and limitations of the implemented nonparametric AV approach were discussed in comparison to item response theory modeling for response styles. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01