Do Loss Aversion and the Ownership Effect Bias Content Validation Procedures?

Autor/inn/en	Svihla, Vanessa; Gallup, Amber
Titel	Do Loss Aversion and the Ownership Effect Bias Content Validation Procedures?
Quelle	In: Practical Assessment, Research & Evaluation, 26 (2021), Artikel 7 (14 Seiten)Infoseite zur Zeitschrift PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1531-7714
Schlagwörter	Content Validity; Anxiety; Bias; Test Items; Ownership; Evaluators; Expertise + Suchen Sie Ihr Suchwort? Angst; Test content; Testaufgabe; Eigentum; Expert appraisal
Abstract	In making validity arguments, a central consideration is whether the instrument fairly and adequately covers intended content, and this is often evaluated by experts. While common procedures exist for quantitatively assessing this, the effect of loss aversion--a cognitive bias that would predict a tendency to retain items--on these procedures has not been investigated. For more novel constructs, experts are typically drawn from adjacent domains. In such cases, a related cognitive bias, the ownership effect, would predict that experts would be more loss averse when considering items closer to their domains. This study investigated whether loss aversion and the ownership effect are a concern in standard content validity evaluation procedures. In addition to including promising items to measure a relatively novel construct, framing agency, we included distractor items linked to other areas of our evaluators' expertise. Experts evaluated all items following procedures outlined by Lawshe (1975). We found on average, experts were able to distinguish between the intended items and distractor items. Likewise, on average, experts were somewhat more likely to reject distractor items closer to their expertise. This suggests that loss aversion and the ownership effect are not likely to bias content validation procedures. (As Provided).
Anmerkungen	Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01