Measuring Evaluator Competencies: Developing and Validating the Evaluator Competencies Assessment Tool

Autor/inn/en	Cho, Minji; Castleman, Ann Marie; Umans, Haley; Mwirigi, Mike Osiemo
Titel	Measuring Evaluator Competencies: Developing and Validating the Evaluator Competencies Assessment Tool
Quelle	In: American Journal of Evaluation, 44 (2023) 3, S.474-494 (21 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Cho, Minji) ORCID (Castleman, Ann Marie) ORCID (Umans, Haley) ORCID (Mwirigi, Mike Osiemo)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1098-2140
DOI	10.1177/10982140211056539
Schlagwörter	Evaluators; Competence; Test Construction; Test Validity; Self Evaluation (Individuals); Factor Analysis; Measures (Individuals) + Suchen Sie Ihr Suchwort? Kompetenz; Testaufbau; Testvalidität; Faktorenanalyse; Messdaten
Abstract	Evaluation scholars have committed decades of work to the development of evaluator competencies. The 2018 American Evaluation Association (AEA) Evaluator Competencies may be useful for evaluators to identify their strengths and weaknesses to improve their practice; however, a few empirically validated self-assessment tools based on the competencies exist. Two studies were conducted to develop a validated tool. The first study (N = 170) developed the Evaluator Competencies Assessment Tool (ECAT), a self-assessment tool based on the AEA, 2018 Evaluator Competencies. This study provided evidence for structural validity via confirmatory factor analysis. The second study (N = 142) reconfirmed structural validity with a new sample and examined variables that are associated with evaluator competencies through correlation and t-test analyses. Having a mentor, years of evaluation experience, age, evaluation training, and education level were positively related to evaluator competencies. The ECAT can be used to foster self-reflection for practitioners to improve evaluation competence. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01