A Validity-Based Approach to Quality Control and Assurance of Automated Scoring

Autor/in	Bejar, Isaac I.
Titel	A Validity-Based Approach to Quality Control and Assurance of Automated Scoring
Quelle	In: Assessment in Education: Principles, Policy & Practice, 18 (2011) 3, S.319-341 (23 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0969-594X
Schlagwörter	Evidence; Quality Control; Scoring; Quality Assurance; Test Validity; Computer Assisted Testing; Automation; Design Preferences; Alignment (Education); Responses; Inferences; Human Factors Engineering; Performance Technology; Computer System Design; Test Construction + Suchen Sie Ihr Suchwort? Evidenz; Qualitätskontrolle; Bewertung; Qualitätssicherung; Testvalidität; Design requirements; Gestaltungsmittel; Inference; Inferenz; Testaufbau
Abstract	Automated scoring of constructed responses is already operational in several testing programmes. However, as the methodology matures and the demand for the utilisation of constructed responses increases, the volume of automated scoring is likely to increase at a fast pace. Quality assurance and control of the scoring process will likely be more prominent as a result. A validity-based approach to ensure the quality of scores based on automated means is proposed. First, an argument is made for aligning quality assurance/control with validity, rather than viewing them as separate processes. Second, to pre-emptively avoid quality and design defects that would erode the validity of scores, it is argued that quality must be "designed in" through the assessment design process by attending to the interdependencies among the different components of an assessment, including scoring. Third, key elements of the design of scoring engines, evidence extraction and evidence synthesis, are discussed as a further avenue for maintaining score quality. (Contains 10 notes, 2 tables, and 1 figure.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10