Literaturnachweis - Detailanzeige
Autor/inn/en | Acosta, Sandra; Garza, Tiberio; Hsu, Hsien-Yuan; Goodson, Patricia |
---|---|
Titel | Assessing Quality in Systematic Literature Reviews: A Study of Novice Rater Training |
Quelle | In: SAGE Open, 10 (2020) 3, (11 Seiten)Infoseite zur Zeitschrift
PDF als Volltext |
Zusatzinformation | ORCID (Garza, Tiberio) |
Sprache | englisch |
Dokumenttyp | gedruckt; online; Zeitschriftenaufsatz |
ISSN | 2158-2440 |
DOI | 10.1177/2158244020939530 |
Schlagwörter | Literature Reviews; Novices; Evidence Based Practice; Evaluators; Training; Graduate Students; Rating Scales; Bias; Problem Solving; Research Skills; Skill Development; Evaluative Thinking |
Abstract | This study investigated performance variability when graduate students critically appraised original studies from a systematic review. Fourteen doctoral students from different academic programs, with no systematic review experience, received training on the Methodological Quality Questionnaire (MQQ) rating scale. Participants were mostly male (71%) and non-native English speakers (79%). Each rater was randomly assigned one original study to independently assess using the MQQ. Their scores were compared to an expert rater. Statistical analysis comprised the following: percentage of agreement (POA), Kappa coefficient, and Kendall's tau-b correlation. On the completed MQQ rating scale, 43% of the novice raters had a POA of 78% or higher with the expert rater. From this case study, a guide for improving training on methodological quality assessment was developed. Benefits include the following: (a) developing and supporting critical reasoning as well as problem-solving skills and (b) increasing research skills and competencies in the systematic review process. (As Provided). |
Anmerkungen | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
Erfasst von | ERIC (Education Resources Information Center), Washington, DC |
Update | 2022/1/01 |