Cognitive Assessment of Subject Matter: Understanding the Marriage of Psychological Theory and Educational Policy in Achievement Testing. [Report No.: CSE-TR-317

Autor/inn/en	Baker, Eva L.; und weitere
Institution	Center for Research on Evaluation, Standards, and Student Testing, Los Angeles, CA.
Titel	Cognitive Assessment of Subject Matter: Understanding the Marriage of Psychological Theory and Educational Policy in Achievement Testing. [Report No.: CSE-TR-317
Quelle	(1990), (24 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Achievement Tests; Advanced Placement Programs; Cognitive Measurement; Comparative Testing; Educational Policy; English; Essay Tests; Evaluators; Grade 11; High School Students; High Schools; History; Interrater Reliability; Knowledge Level; Reading Comprehension; Scoring; Secondary School Teachers; Standardized Tests; Test Construction; Writing Tests + Suchen Sie Ihr Suchwort? Achievement test; Achievement; Testing; Test; Tests; Leistungsbeurteilung; Leistungsüberprüfung; Leistung; Testdurchführung; Testen; Politics of education; Bildungspolitik; English language; Englisch; Schriftlicher Sprachgebrauch; School year 11; 11. Schuljahr; Schuljahr 11; High school; High schools; Student; Students; Oberschule; Schüler; Schülerin; Studentin; Geschichte; Geschichtsdarstellung; Interrater-Reliabilität; Wissensbasis; Leseverstehen; Bewertung; Standadised tests; Standardisierter Test; Testaufbau; Writing test; Schreibtest
Abstract	As part of a project on assessing deep understanding of subject matter, a study was conducted to assess students' knowledge of history by focusing on essay writing. Reading a provided text was incorporated into the assessment procedure. Ratings from five high school history teachers were compared with those of four English teachers for 85 essays from 11th-grade advanced placement students in a suburban high school. No significant differences in student performance were found for the two text passages or question type (brief or extended) in ratings of either group. English and history teachers were looking at student papers in fundamentally similar ways, but scoring criteria were not adequate in that they focused on what teachers said they valued, rather than what they actually would write themselves. Using an expert-novice model, new questions were developed, and the new test was administered to 250 11th graders and scored under new scoring rubrics. Higher interrater reliabilities encouraged researchers to train four history teachers in the new scoring approach. Ongoing research is examining the utility of the new scoring focus for high school students in two school districts. The study illustrates the complexity of developing new and useful assessments. Eight tables summarize test development principles, and a 30-item list of references is included. (SLD)
Anmerkungen	CSE Dissemination Office, UCLA Graduate School of Education, 405 Hilgard Avenue, Los Angeles, CA 90024-1521.
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2004/1/01