Design of Peer Assessment Rubrics for ICT Topics

Autor/inn/en	Bowen-Mendoza, Lorena; Pinargote-Ortega, Maricela; Meza, Jaime; Ventura, Sebastián
Titel	Design of Peer Assessment Rubrics for ICT Topics
Quelle	In: Journal of Computing in Higher Education, 34 (2022) 1, S.211-241 (31 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Bowen-Mendoza, Lorena)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1042-1726
DOI	10.1007/s12528-021-09297-9
Schlagwörter	Peer Evaluation; Student Evaluation; Scoring Rubrics; Information Technology; Evaluation Criteria; Test Reliability; Content Validity; Grading; Scores; Likert Scales; Student Satisfaction + Suchen Sie Ihr Suchwort? Schulnote; Studentische Bewertung; Scoring formulas; Auswertungsbogen; Informationstechnologie; Testreliabilität; Notengebung; Likert-Skala
Abstract	Peer evaluation consists of the evaluation of students by their peers following criteria or rubrics provided by the teacher, where the way to evaluate students is specified so that they achieve the desired competencies. The quality of the measurement instrument must meet two essential criteria: validity and reliability. In this research, we explored the educational value of peer evaluation rubrics by analyzing the quality of the rubric through the study of content validity, reliability, and internal consistency. Our main purpose was to design an appropriate rubric to grade tasks in the field of information engineering, as well as performing content validation through a group of experts. It was carried out in three phases: 1) construction of a rubric, with its criteria, characteristics, and levels of achievement; 2) content validation by five experts in the field, and 3) application of the rubric to ascertain students' perceptions and satisfaction with its validity. The relevance of the criteria and the definition of their characteristics obtained a score higher than 3.75/4 on a Likert scale. The content validity values (CVR), content validity index (CVI), and general content validity index (GIVC) gave maximum values of + 1. The results obtained indicate that the rubric is adequate, with Aiken's V higher than V 0.87 in all its criteria. The rubric was applied to 326 students of 4 subjects. Cronbach's alpha was used to calculate the reliability of the rubric, obtaining a value of 0.839. The students' perception of validity and satisfaction with the rubric was higher than 0.78. As future work, we intend to design a rubric validation engine according to the applied procedure. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01