A Case Study of an International Performance-Based Assessment of Critical Thinking Skills

Literaturnachweis - Detailanzeige

Trefferliste

Autor/inn/en	Wolf, Raffaela; Zahner, Doris; Kostoris, Fiorella; Benjamin, Roger
Institution	Council for Aid to Education (CAE)
Titel	A Case Study of an International Performance-Based Assessment of Critical Thinking Skills
Quelle	(2014), (8 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Case Studies; International Assessment; Performance Based Assessment; Critical Thinking; Writing Skills; Writing Evaluation; Feasibility Studies; College Students; Student Evaluation; Foreign Countries; Comparative Education; Test Format; Test Bias; Student Attitudes; Test Validity; Test Interpretation; Scores; Test Construction; Scoring; Statistical Analysis; Factor Analysis; Italy; United States + Suchen Sie Ihr Suchwort? Case study; Fallstudie; Case Study; Leistungsermittlung; Kritisches Denken; Writing skill; Schreibfertigkeit; Collegestudent; Schulnote; Studentische Bewertung; Ausland; Vergleichende Erziehungswissenschaft; Testentwicklung; Testkritik; Schülerverhalten; Testvalidität; Test analysis; Testauswertung; Testaufbau; Bewertung; Statistische Analyse; Faktorenanalyse; Italien; USA
Abstract	The measurement of higher-order competencies within a tertiary education system across countries presents methodological challenges due to differences in educational systems, socio-economic factors, and perceptions as to which constructs should be assessed (Blömeke, Zlatkin-Troitschanskaia, Kuhn, & Fege, 2013). According to Hart Research Associates (2009), there is substantial merit in assessing twenty-first century skills such as critical thinking and writing since about 78% of academic institutions in the United States have established crossdiscipline learning outcomes, so called meta domains (Porter, McMaken, Hwang, & Yang, 2011), that all undergraduate students should possess upon graduation. Furthermore, changing skill demands of graduating students have been observed around the world since the 1990s (Levy & Murname, 2004). Meeting the demands of today's world requires a shift in assessment strategies to measure the skills now prized in a complex global environment. More specifically, assessments that only foster the recall of factual knowledge have been on the decline, whereas assessments that evoke higher-order cognitive skills have seen an accelerating demand in the twenty-first century. As an example, CAE (the Council for Aid to Education) has been developing assessments that target higher-order skills. The Collegiate Learning Assessment-plus (CLA+) is a measure that emulates critical-thinking and writing skills. In late 2012, the Agenzia Nazionale di Valutazione del Sistema Universitario e della Ricerca (ANVUR) approached CAE proposing a research study to test the feasibility of adapting, translating, and administering CLA+ to higher education students in Italy. The purpose of this feasibility study was twofold. The first purpose was to see if it was possible to assess Italian students' higher-order skills as outlined in Table 1. The second purpose was to see if the Italian students' performance was comparable to their American counterparts. CLA+ is a mixed-format type assessment; thus this paper presents the results from the feasibility study as a case study of the successful adaption, translation, and administration of CLA+ in 12 Italian institutions. A discussion is provided regarding how different biases may be addressed within an international context. A second analysis examined whether students from Italy and the US ascribe the same meanings to different item formats (PT and SRQs) thus addressing the issue of measurement equivalence and the feasibility of cross-cultural score comparisons. Results are interpreted within a validity framework. (ERIC).
Anmerkungen	Council for Aid to Education. 215 Lexington Avenue 16th Floor, New York, NY 10016. Tel: 212-661-5800; Fax: 212-661-9766; e-mail: clateam@cae.org; Web site: http://cae.org
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01