Literaturnachweis - Detailanzeige
| Autor/inn/en | Jin, Kuan-Yu; Eckes, Thomas |
|---|---|
| Titel | Detecting Differential Rater Functioning in Severity and Centrality: The Dual DRF Facets Model |
| Quelle | In: Educational and Psychological Measurement, 82 (2022) 4, S.757-781 (25 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
| Zusatzinformation | ORCID (Jin, Kuan-Yu) |
| Sprache | englisch |
| Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
| ISSN | 0013-1644 |
| DOI | 10.1177/00131644211043207 |
| Schlagwörter | Performance Based Assessment; Rating Scales; Test Bias; Student Evaluation; Influences; Measurement Techniques; Language Tests; German; Foreign Countries; Foreign Students; College Students; Gender Differences; Germany |
| Abstract | Performance assessments heavily rely on human ratings. These ratings are typically subject to various forms of error and bias, threatening the assessment outcomes' validity and fairness. Differential rater functioning (DRF) is a special kind of threat to fairness manifesting itself in unwanted interactions between raters and performance- or construct-irrelevant factors (e.g., examinee gender, rater experience, or time of rating). Most DRF studies have focused on whether raters show differential severity toward known groups of examinees. This study expands the DRF framework and investigates the more complex case of dual DRF effects, where DRF is simultaneously present in rater severity and centrality. Adopting a facets modeling approach, we propose the dual DRF model (DDRFM) for detecting and measuring these effects. In two simulation studies, we found that dual DRF effects (a) negatively affected measurement quality and (b) can reliably be detected and compensated under the DDRFM. Using sample data from a large-scale writing assessment (N = 1,323), we demonstrate the practical measurement consequences of the dual DRF effects. Findings have implications for researchers and practitioners assessing the psychometric quality of ratings. (As Provided). |
| Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
| Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
| Update | 2024/1/01 |
Literaturbeschaffung und Bestandsnachweise in Bibliotheken prüfen
Permalink als QR-Code
Inhalt auf sozialen Plattformen teilen (nur vorhanden, wenn Javascript eingeschaltet ist)
Teile diese Seite:
