PISA 2018 in England, Northern Ireland, Scotland and Wales: Is the Data Really Representative of All Four Corners of the UK?

Autor/in	Jerrim, John
Titel	PISA 2018 in England, Northern Ireland, Scotland and Wales: Is the Data Really Representative of All Four Corners of the UK?
Quelle	In: Review of Education, 9 (2021) 3Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Jerrim, John)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	2049-6613
DOI	10.1002/rev3.3270
Schlagwörter	Achievement Tests; Foreign Countries; Secondary School Students; International Assessment; Data Analysis; Test Bias; United Kingdom (England); United Kingdom (Northern Ireland); United Kingdom (Scotland); United Kingdom (Wales); Program for International Student Assessment + Suchen Sie Ihr Suchwort? Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Ausland; Sekundarschüler; Auswertung; Testkritik
Abstract	PISA is an influential international study of the achievement of 15-year-olds. It has a high profile across the devolved nations of the UK, with the results having a substantial impact upon education policy. Yet many of the technical details underpinning PISA remain poorly understood--particularly amongst non-specialists--including important nuances surrounding the representivity of the data. This paper provides new evidence on this issue, based upon a case study of PISA 2018. I illustrate how there are many anomalies with the data, with the combination of nonresponse, exclusions from the test and technical details surrounding eligibility criteria leading to total nonparticipation rates of around 40% (amongst the highest anywhere in the world). It is then shown how this leads to substantial uncertainty surrounding the PISA results, with clear evidence of bias in the sample for certain parts of the UK. I conclude by discussing how more transparent reporting of the technical details underpinning PISA is needed, at both a national and international level. (As Provided).
Anmerkungen	Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01