Modification and Validation of the Mixed-Format Engineering Concept Assessment for Middle School Students Using Many-Facet Rasch Measurement

Autor/inn/en	Koskey, Kristin L. K.; Makki, Nidaa; Ahmed, Wondimu; Garafolo, Nicholas G.; Visco, Donald P., Jr.
Titel	Modification and Validation of the Mixed-Format Engineering Concept Assessment for Middle School Students Using Many-Facet Rasch Measurement
Quelle	In: School Science and Mathematics, 120 (2020) 5, S.245-257 (13 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0036-6803
DOI	10.1111/ssm.12405
Schlagwörter	Middle School Students; Engineering; Design; Science Education; Integrated Curriculum; Science Curriculum; Student Evaluation; Evaluation Methods; Multiple Choice Tests; Item Response Theory; Scoring Rubrics; Grade 8; Test Items; Test Reliability; Test Validity + Suchen Sie Ihr Suchwort? Middle school; Middle schools; Student; Students; Mittelschule; Mittelstufenschule; Schüler; Schülerin; Maschinenbau; Naturwissenschaftliche Bildung; Schulnote; Studentische Bewertung; Multiple choice examinations; Multiple-choice tests, Multiple-choice examinations; Multiple-Choice-Verfahren; Item-Response-Theorie; Scoring formulas; Auswertungsbogen; School year 08; 8. Schuljahr; Schuljahr 08; Test content; Testaufgabe; Testreliabilität; Testvalidität
Abstract	Integrating engineering into the K-12 science curriculum continues to be a focus in national reform efforts in science education. Although there is an increasing interest in research in and practice of integrating engineering in K-12 science education, to date only a few studies have focused on the development of an assessment tool to measure students' understanding of engineering design. Most of the existing measures focus only on knowledge and understanding of engineering design concepts using multiple-choice items with the exception of the mixed-format Engineering Concept Assessment (ECA). Also, advanced measurement models are lacking application in the testing of such mixed-format assessments in science education. This study applied many-faceted Rasch measurement to the modified ECA for eighth-grade (ECA/M8) and a newly constructed rubric applied by five judges across 497 eighth-grade students' responses after experiencing an integrated learning unit on the engineering design process. The results supported the fit of the items and rubric rating scales to the Rasch specifications. Recommendations are made for item wording, and further reliability and validity testing of the ECA/M8, and use of the ECA/M8 in science education and research. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01