Evaluating Score and Decision Consistency across Claims in a Validation Argument

Autor/in	Schmidgall, Jonathan
Titel	Evaluating Score and Decision Consistency across Claims in a Validation Argument
Quelle	In: Applied Measurement in Education, 30 (2017) 4, S.287-296 (10 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0895-7347
DOI	10.1080/08957347.2017.1353988
Schlagwörter	Scores; Reliability; Validity; Generalizability Theory; Decision Making; Computation; Error Patterns; Test Interpretation; Language Proficiency; Language Tests; Performance Based Assessment; English (Second Language); Graduate Students; Foreign Students; California (Los Angeles) + Suchen Sie Ihr Suchwort? Reliabilität; Gültigkeit; Decision-making; Entscheidungsfindung; Fehlertyp; Test analysis; Testauswertung; Language skill; Language skills; Sprachkompetenz; Language test; Sprachtest; Leistungsermittlung; English as second language; English; Second Language; Englisch als Zweitsprache; Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin
Abstract	This study utilizes an argument-based approach to validation to examine the implications of reliability in order to further differentiate the concepts of score and decision consistency. In a methodological example, the framework of generalizability theory was used to estimate appropriate indices of score consistency and evaluations of the likelihood of decision errors based on the design of a performance assessment and its intended use. The study illustrates how generalizability theory can be applied to address various claims about consistency when decisions are based on two or more cut scores, and results underscore the importance of considering score and decision consistency separately. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01