Peer Assessment of Webpage Design: Behavioral Sequential Analysis Based on Eye-Tracking Evidence

Autor/inn/en	Hsu, Ting-Chia; Chang, Shao-Chen; Liu, Nan-Cen
Titel	Peer Assessment of Webpage Design: Behavioral Sequential Analysis Based on Eye-Tracking Evidence
Quelle	In: Educational Technology & Society, 21 (2018) 2, S.305-321 (17 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1436-4522
Schlagwörter	Eye Movements; Measurement; Peer Evaluation; Web Sites; Undergraduate Students; Cognitive Style; Visual Perception; Student Attitudes; Attitude Measures; Comparative Analysis; Design; Scores; Attention; Foreign Countries; Questionnaires; Measurement Equipment; Qualitative Research; Statistical Analysis; Taiwan + Suchen Sie Ihr Suchwort? Augenbewegung; Messverfahren; Web-Design; Cognitive styles; Kognitiver Stil; Visuelle Wahrnehmung; Schülerverhalten; Aufmerksamkeit; Ausland; Fragebogen; Messinstrument; Qualitative Forschung; Statistische Analyse
Abstract	This study employed an eye-tracking machine to record the process of peer assessment. Each web page was divided into several regions of interest (ROIs) based on the frame design and content. A total of 49 undergraduate students with a visual learning style participated in the experiment. This study investigated the peer assessment attitudes of the participants and found that they possessed highly positive attitudes towards and understanding of peer assessment. After comparing the results of the peer assessments and evaluation by experts, high consistency occurred when the design of the web page was concise; however, the consistency decreased when the web page content was too diverse. After comparing the peer assessment attitudes of the participants and their web page design scores, it was found that the web pages with concise designs attracted the visual-style students' attention more, and that there was a significant negative correlation for those students who possessed a more negative attitude toward peer assessment. In addition, the study further analyzed the visual-style students' serial behaviors in the peer assessment process for each web page design. After comparing the evidence of each student's eye movements and his/her evaluation results, it was found that the students who gave higher or lower scores had different eye movements. For the website scored as having the best design, the fixations and behaviors of the assessors giving higher scores were highly consistent with those of the experts, implying that the few assessors giving lower scores were relatively poor at peer assessment. On the contrary, for the website which was scored as having the worst design, the fixations and behaviors of the assessors giving lower scores were highly consistent with those of the experts. Consequently, from the eye-fixation hotspot evidence, when the students were more concentrated on the peer assessment, their evaluated results were closer to those of the two experts. Finally, the study found that the eye-fixation hotspots were the same as the key points planned by the student designers of the website which scored the highest, which provided the student designers with additional important eye-tracking feedback from the peer-assessment activities. (As Provided).
Anmerkungen	International Forum of Educational Technology & Society. Available from: National Sun Yat-sen University. Department of Information Management, 70, Lien-Hai Rd, Kaohsiung, 80424, Taiwan. Web site: http://www.ifets.info
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01