Application of Artificial Intelligence Techniques in Analysis and Assessment of Digital Competence in University Courses

Autor/in	Yang, Tzu-Chi
Titel	Application of Artificial Intelligence Techniques in Analysis and Assessment of Digital Competence in University Courses
Quelle	In: Educational Technology & Society, 26 (2023) 1, S.232-243 (12 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1176-3647
Schlagwörter	Artificial Intelligence; Digital Literacy; Natural Language Processing; Higher Education; Course Descriptions; Competence; Teaching Methods + Suchen Sie Ihr Suchwort? Künstliche Intelligenz; Natürliche Sprache; Hochschulbildung; Hochschulsystem; Hochschulwesen; Kursstrukturplan; Kompetenz; Teaching method; Lehrmethode; Unterrichtsmethode
Abstract	The development of digital competence has become an important part of higher education, and digital competence assessments have attracted considerable attention and concerns. Previous studies in this area mainly focused on self-reporting and manual review methods such as questionnaires, which offer limited assessment value. To solve this issue, this study uses natural language processing (NLP)--a current promising artificial intelligence (AI) technology--to analyze syllabi for assessing digital competence in universities. Analysis results show that the proposed method can achieve an average accuracy and consistency of over 80% with excellent efficiency. Moreover, the method demonstrates high consistency with manual evaluation results (kappa > 0.6) and enables automated large-scale objective assessment. In brief, the results suggest that the proposed method is efficient, effective, and reliable, making it a valuable solution for digital competence assessment. We accordingly explore the application expansion of this method in building the digital competence of universities. Furthermore, we discuss the theoretical, methodological, and applied contributions of this study. (As Provided).
Anmerkungen	International Forum of Educational Technology & Society. Available from: National Yunlin University of Science and Technology. No. 123, Section 3, Daxue Road, Douliu City, Yunlin County, Taiwan 64002. e-mail: journal.ets@gmail.com; Web site: https://www.j-ets.net/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01