The Case for Scenario-Based Assessment of Written Argumentation

Autor/inn/en	Deane, Paul; Song, Yi; van Rijn, Peter; O'Reilly, Tenaha; Fowles, Mary; Bennett, Randy; Sabatini, John; Zhang, Mo
Titel	The Case for Scenario-Based Assessment of Written Argumentation
Quelle	In: Reading and Writing: An Interdisciplinary Journal, 32 (2019) 6, S.1575-1606 (32 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Deane, Paul)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0922-4777
DOI	10.1007/s11145-018-9852-7
Schlagwörter	Vignettes; Writing Skills; Persuasive Discourse; Writing Evaluation; Measurement; Evaluation Methods; Test Items; Writing Tests; Essays; Academic Language; Language Proficiency; Vocabulary Skills; Language Fluency; Language Usage; Scores; Behavior Patterns; Writing Processes; Literacy; Item Analysis; Writing Instruction + Suchen Sie Ihr Suchwort? Writing skill; Schreibfertigkeit; Persuasion; Persuasive Kommunikation; Messverfahren; Test content; Testaufgabe; Writing test; Schreibtest; Essay; Aufsatzunterricht; Academic; Language; Languages; Akademiker; Sprache; Wissenschaftssprache; Language skill; Language skills; Sprachkompetenz; Aktiver Wortschatz; Sprachgebrauch; Alphabetisierung; Schreib- und Lesefähigkeit; Itemanalyse; Schreibunterricht
Abstract	This paper presents a theoretical and empirical case for the value of scenario-based assessment (SBA) in the measurement of students' written argumentation skills. First, we frame the problem in terms of creating a reasonably efficient method of evaluating written argumentation skills, including for students at relatively low levels of competency. We next present a proposed solution in the form of an SBA and lay out the design for such an assessment. We then describe the results of prior research done within our group using this design. Fourth, we present the results of two new analyses of prior data that extend our previous results. These analyses concern whether the test items behave in ways consistent with the learning progressions underlying the design, how items measuring reading and writing component skills relate to essay performance, how measures of transcription fluency and proficiency in oral and academic language relate to writing skill, and whether the scenario-based design affects the fluency and vocabulary used in an essay. Results suggest that students can be differentiated by learning progression level, with variance in writing scores accounted for by a combination of performance on earlier tasks in the scenario and automated linguistic features measuring general literacy skills. The SBA structure, with preliminary tasks leading up to the final written performance, appears to result in more fluent (and also more efficient) writing behavior, compared to students' performances when they write an essay in isolation. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01