Defining and Measuring Completion and Assessment Biases with Respect to English Language and Development Status: Not All MOOCs Are Equal

Autor/inn/en	Karp Gershon, Sa'ar; Ruipérez-Valiente, José A.; Alexandron, Giora
Titel	Defining and Measuring Completion and Assessment Biases with Respect to English Language and Development Status: Not All MOOCs Are Equal
Quelle	In: International Journal of Educational Technology in Higher Education, 18 (2021), Artikel 41 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Karp Gershon, Sa'ar)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2365-9440
DOI	10.1186/s41239-021-00275-w
Schlagwörter	Online Courses; Access to Education; Developing Nations; Academic Achievement; Item Response Theory; Test Bias; Student Evaluation + Suchen Sie Ihr Suchwort? Online course; Online-Kurs; Education; Access; Bildung; Zugang; Bildungszugang; Developing country; Developing countries; Entwicklungsland; Schulleistung; Item-Response-Theorie; Testkritik; Schulnote; Studentische Bewertung
Abstract	The emergence of Massive Open Online Courses (MOOCs) broadened the educational landscape by providing free access to quality learning materials for anyone with a device connected to the Internet. However, open access does not guarantee equals opportunities to learn, and research has repetitively reported that learners from affluent countries benefit the most from MOOCs. In this work, we delve into this gap by defining and measuring completion and assessment biases with respect to learners' language and development status. We do so by performing a large-scale analysis across 158 MITx MOOC runs from 120 different courses offered on edX between 2013 and 2018, with 2.8 million enrollments. We see that learners from developing countries are less likely to complete MOOCs successfully, but we do not find evidence regarding a negative effect of not being English-native. Our findings point out that not only the specific population of learners is responsible for this bias, but also that the course itself has a similar impact. Independent of and less frequent than completion bias, we found assessment bias, that is when the mean ability gained by learners from developing countries is lower than that of learners from developed countries. The ability is inferred from the responses of the learners to the course-assessment using item response theory (IRT). Finally, we applied differential item functioning (DIF) methods with the objective of detecting items that might be causing the assessment bias, obtaining weak, yet positive results with respect to the magnitude of the bias reduction. Our results provide statistical evidence on the role that course design might have on these biases, with a call for action so that the future generation of MOOCs focus on strengthening their inclusive design approaches. (As Provided).
Anmerkungen	BioMed Central, Ltd. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://www.springer.com/gp/biomedical-sciences
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01