Agree or Disagree: Does It Matter Which Comes First? An Examination of Scale Direction Effects in a Multi-Device Online Survey

Autor/inn/en	Leon, Carmen M.; Aizpurua, Eva; van der Valk, Sophie
Titel	Agree or Disagree: Does It Matter Which Comes First? An Examination of Scale Direction Effects in a Multi-Device Online Survey
Quelle	In: Field Methods, 34 (2022) 2, S.125-142 (18 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1525-822X
DOI	10.1177/1525822X211012259
Schlagwörter	Online Surveys; Comparative Analysis; Questionnaires; Foreign Countries; Rating Scales; Telecommunications; Handheld Devices; Correlation; Data Collection; Misconceptions; Family Violence; Gender Bias; Scores; Participant Characteristics; Spain + Suchen Sie Ihr Suchwort? Fragebogen; Ausland; Rating-Skala; Telekommunikationstechnik; Korrelation; Data capture; Datensammlung; Missverständnis; Geschlechterstereotyp; Spanien
Abstract	Previous research shows that the direction of rating scales can influence participants' response behavior. Studies also suggest that the device used to complete online surveys might affect the susceptibility to these effects due to the different question layouts (e.g., horizontal grids vs. vertical individual questions). This article contributes to previous research by examining scale direction effects in an online multi-device survey conducted with panelists in Spain. In this experiment, respondents were randomly assigned to two groups where the scale direction was manipulated (incremental vs. decremental). Respondents completed the questionnaire using the device of their choosing (57.8% used PCs; 36.5% used smartphones; and 5.7% used tablets). The results show that scale direction influenced response distributions but did not significantly affect data quality. In addition, our findings indicate that scale direction effects were comparable across devices. Findings are discussed and implications are highlighted. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01