An Alternative Decision-Making Procedure for Performance Assessments: Using the Multifaceted Rash Model to Generate Cut Estimates

Autor/in	Kozaki, Yoko
Titel	An Alternative Decision-Making Procedure for Performance Assessments: Using the Multifaceted Rash Model to Generate Cut Estimates
Quelle	In: Language Assessment Quarterly, 7 (2010) 1, S.75-95 (21 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1543-4303
Schlagwörter	Performance Based Assessment; Standard Setting; Decision Making; Certification; Translation; Case Studies; Language Tests; Second Languages; English (Second Language); Japanese; Evaluators; Medical Research; Statistical Analysis; Foreign Countries; Second Language Instruction + Suchen Sie Ihr Suchwort? Leistungsermittlung; Standardisierung; Decision-making; Entscheidungsfindung; Abschlusszeugnis; Zertifizierung; Case study; Fallstudie; Case Study; Language test; Sprachtest; Second language; Zweitsprache; English as second language; English; Second Language; Englisch als Zweitsprache; Japaner; Japanisch; Statistische Analyse; Ausland; Fremdsprachenunterricht
Abstract	This article describes an alternative approach to setting standards for performance assessments. The procedure was designed for use in low-budget, relatively low-stakes contexts where it is not possible to bring expert judges together. The procedure that allowed participant judges to work individually throughout the process was an effort to compensate for the lack of face-to-face interactions between judges. The viability of the proposed procedure in generating workable cut estimates was examined via its application to a certification examination in medical translation. Data were collected from a case study conducted by Kozaki (2004) and its replication, which were linked together by the Multifaceted Rasch Model into a single frame of reference. The results showed that the judges' intentions were overall well represented in the generated cut estimates and that the decision making was realistic. It is suggested that the proposed procedure should offer a viable alternative in relatively low-stakes environments to full-fledged standard-setting procedures and that thus it may be of benefit to examiners who need principled approaches to setting cut estimates for performance assessments with constrained budgets. (Contains 10 tables, 3 figures, and 4 footnotes.) (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10