Survey Mode and Data Quality: Careless Responding across Three Modes in Cross-Cultural Contexts

Autor/inn/en	Magraw-Mickelson, Zoe; Wang, Harry H.; Gollwitzer, Mario
Titel	Survey Mode and Data Quality: Careless Responding across Three Modes in Cross-Cultural Contexts
Quelle	In: International Journal of Testing, 22 (2022) 2, S.121-153 (33 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Magraw-Mickelson, Zoe)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1530-5058
DOI	10.1080/15305058.2021.2019747
Schlagwörter	Response Style (Tests); Surveys; Data Collection; Test Format; Cross Cultural Studies; Computer Assisted Testing; Handheld Devices; Foreign Countries; Cultural Differences; Adults; Employees; College Students; Chinese; China; Germany + Suchen Sie Ihr Suchwort? Antwortverhalten; Survey; Umfrage; Befragung; Data capture; Datensammlung; Testentwicklung; Cultural comparison; Kulturvergleich; Ausland; Kultureller Unterschied; Employee; Arbeitnehmer; Beschäftigter; Collegestudent; China; Chinesen; Deutschland
Abstract	Much psychological research depends on participants' diligence in filling out materials such as surveys. However, not all participants are motivated to respond attentively, which leads to unintended issues with data quality, known as careless responding. Our question is: how do different modes of data collection--paper/pencil, computer/web-based, and smartphone--affect participants' diligence vs. "careless responding" tendencies and, thus, data quality? Results from prior studies suggest that different data collection modes produce a comparable prevalence of careless responding tendencies. However, as technology develops and data are collected with increasingly diversified populations, this question needs to be readdressed and taken further. The present research examined the effect of survey mode on careless responding in a repeated-measures design with data from three different samples. First, in a sample of working adults from China, we found that participants were slightly more careless when completing computer/web-based survey materials than in paper/pencil mode. Next, in a German student sample, participants were slightly more careless when completing the paper/pencil mode compared to the smartphone mode. Finally, in a sample of Chinese-speaking students, we found no difference between modes. Overall, in a meta-analysis of the findings, we found minimal difference between modes across cultures. Theoretical and practical implications are discussed. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01