A Comparison Study of NAEP-TEL and ICILS

Autor/inn/en	Wang, Yan; Murphy, Kevin B.
Institution	National Center for Education Statistics (ED); American Institutes for Research (AIR)
Titel	A Comparison Study of NAEP-TEL and ICILS
Quelle	(2020), (57 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Quantitative Daten; National Competency Tests; International Assessment; Computer Literacy; Information Literacy; Technological Literacy; Grade 8; Test Items; Test Content; Computer Assisted Testing; Comparative Analysis; Test Format; National Assessment of Educational Progress + Suchen Sie Ihr Suchwort? Computerkenntnisse; Informationskompetenz; Technisches Wissen; School year 08; 8. Schuljahr; Schuljahr 08; Test content; Testaufgabe; Testentwicklung
Abstract	In 2018, the National Center for Education Statistics (NCES) administered two assessments--the National Assessment of Educational Progress (NAEP) Technology and Engineering Literacy (TEL) assessment and the International Computer and Information Literacy Study (ICILS)--to two separate nationally representative samples of 8th-grade students in the United States. TEL was administered in January-March to 15,400 students, while ICILS was administered in March-May to 9,000 students. Because of some similarities in content and item formats, NCES commissioned a study to explore the similarities and differences between the two assessment frameworks as well as the characteristics of the assessment items. The results of the comparison study showed that the framework targets and design features underlying the scenario-based tasks (SBTs) used in both assessments have many similarities. Both assessments have a focus on information and communication technologies, and both are digital-based assessments that use interactive features in item design. However, there are differences between the two assessments in framework scope and item characteristics. About half of the TEL framework targets are beyond the scope of ICILS; TEL evaluates students' knowledge and skills in analyzing general systems, while ICILS limits its evaluation to computer systems. ICILS uses some response modes (e.g., flowcharts) that are not used in TEL. Forty-two percent of the ICILS items do not allow students to go back to the previous item to change their answers, compared with 85 percent of the TEL SBT items. About two-thirds of ICILS items assess procedural knowledge, while only about one-third of TEL SBT items do that. (ERIC).
Anmerkungen	National Center for Education Statistics. Available from: ED Pubs. P.O. Box 1398, Jessup, MD 20794-1398. Tel: 877-433-7827; Web site: http://nces.ed.gov/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01