Exploring Scenario-Based Assessment of Students' Global Engineering Competency: Building Evidence of Validity of a China-Based Situational Judgment Test

Autor/inn/en	Davis, Kirsten A.; Jesiek, Brent K.; Knight, David B.
Titel	Exploring Scenario-Based Assessment of Students' Global Engineering Competency: Building Evidence of Validity of a China-Based Situational Judgment Test
Quelle	In: Journal of Engineering Education, 112 (2023) 4, S.1032-1055 (24 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Davis, Kirsten A.) ORCID (Jesiek, Brent K.) ORCID (Knight, David B.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1069-4730
DOI	10.1002/jee.20552
Schlagwörter	Vignettes; Engineering Education; Study Abroad; Foreign Countries; Global Approach; Decision Making; Tests; Competence; Prior Learning; Student Attitudes; Student Surveys; Comparative Analysis; Test Validity; Evaluation Methods; China + Suchen Sie Ihr Suchwort? Ingenieurausbildung; Studies abroad; Auslandsstudium; Ausland; Globales Denken; Decision-making; Entscheidungsfindung; Examination; Prüfung; Examen; Kompetenz; Vorkenntnisse; Schülerverhalten; Schülerbefragung; Testvalidität
Abstract	Background: Engineers operate in an increasingly global environment, making it important that engineering students develop global engineering competency to prepare them for success in the workplace. To understand this learning, we need assessment approaches that go beyond traditional self-report surveys. A previous study (Jesiek et al., "Journal of Engineering Education" 2020; 109(3):1-21) began this process by developing a situational judgment test (SJT) to assess global engineering competency based in the Chinese context and administering it to practicing engineers. Purpose: We built on this previous study by administering the SJT to engineering students to explore what prior experiences related to their SJT performance and how their SJT performance compared with practicing engineers' performance on the SJT. Method: Engineering students completed a survey including the SJT and related self-report survey instruments. We collected data from three groups of students: those who had studied abroad in China; those who had studied abroad elsewhere; and those who had not studied abroad. Results: We found that students' SJT performance did not relate to their scores on the self-report instruments, but did relate to their participation in study abroad programs. The students also performed better on the SJT when compared to the practicing engineers. Conclusions: Our results highlight the need to use multiple forms of assessment for global engineering competence. Although building evidence for the validity of the Global Engineering Competency China SJT is an ongoing process, this data collection technique may provide new insights on global engineering competency compared to traditionally used assessments. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01