NEPS technical report for science: Scaling results of starting cohort 2 for grade 1.

Autor/in	Kähler, Jana
Titel	NEPS technical report for science: Scaling results of starting cohort 2 for grade 1. Gefälligkeitsübersetzung: NEPS technischer Bericht für Naturwissenschaften: Skalierungsergebnisse der Startkohorte 2 für Klasse 1.
Quelle	Bamberg: Leibniz Institute for Educational Trajectories (2019), 29 S. PDF als Volltext kostenfreie Datei Link als defekt meldenVerfügbarkeit
Reihe	NEPS Survey Paper. 58
Sprache	englisch
Dokumenttyp	online; Monografie
DOI	10.5157/NEPS:SP58:1.0
Schlagwörter	Kompetenz; Skalierung; Testkonstruktion; Testreliabilität; Fertigkeit; Pädagogische Diagnostik; Test; Grundschule; Schüler; Schülerleistung; Wissenstest; Naturwissenschaftliche Bildung
Abstract	The National Educational Panel Study (NEPS) examines the development of competencies across the life span and develops tests for the assessment of different competence domains. In order to evaluate the quality of these competence tests various analyses based on item response theory (IRT) were performed. This paper describes the data and scaling procedures for the scientific literacy test that was administered in grade 1 of starting cohort 2. The scientific literacy test contained 25 items with different response formats representing different contexts as well as different areas of knowledge. The test was administered to 6,734 students. Their responses were scaled using a partial credit model. Item fit statistics, differential item functioning, Rasch-homogeneity, the test's dimensionality, and local item independence were evaluated to ensure the quality of the test. These analyses showed that the test exhibited a good reliability and that all items fitted the model in a satisfactory way. Furthermore, test fairness could be confirmed for different subgroups. As the correlations between the two knowledge domains were very high, the assumption of unidimensionality seems adequate. A limitation of the test was the lack of very difficult items. However, the results revealed good psychometric properties of the scientific literacy test, thus, supporting the estimation of a reliable scientific literacy score. Besides the scaling results, this paper also describes the data available in the scientific use file and provides the ConQuest syntax for scaling the data. Additionally, the design and results of the linking study for the competence scores in kindergarten and grade 1 are presented. - Contents: (1) Testing scientific literacy. (2) Data (The design of the study; Sample). (3) Analyses (Missing responses; Scaling model; Checking the quality of the test; Software). (4) Results (Descriptive statistics of the responses; Missing responses; Parameter estimates; Quality of the test). (5) Discussion. (6) Data in the scientific use file (Naming conventions; Linking of competence scores; Scientific literacy scores). (ZPID).
Erfasst von	Leibniz-Institut für Psychologie, Trier
Update	2025/3