How Progress Evaluations Are Used in Postgraduate Education with Longitudinal Supervisor-Trainee Relationships: A Mixed Method Study

Autor/inn/en	Westein, Marnix P. D.; Koster, A. S.; Daelmans, H. E. M.; Bouvy, M. L.; Kusurkar, R. A.
Titel	How Progress Evaluations Are Used in Postgraduate Education with Longitudinal Supervisor-Trainee Relationships: A Mixed Method Study
Quelle	In: Advances in Health Sciences Education, 28 (2023) 1, S.205-222 (18 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Westein, Marnix P. D.) ORCID (Koster, A. S.) ORCID (Daelmans, H. E. M.) ORCID (Bouvy, M. L.) ORCID (Kusurkar, R. A.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1382-4996
DOI	10.1007/s10459-022-10153-3
Schlagwörter	Program Evaluation; Formative Evaluation; Summative Evaluation; Performance Based Assessment; Graduate Students; Feedback (Response); Supervisors; Trainees; Scores; Supervisor Supervisee Relationship; Pharmaceutical Education; Specialization; Role + Suchen Sie Ihr Suchwort? Programme evaluation; Programmevaluation; Leistungsermittlung; Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin; Auszubildender; Weibliche Auszubildende; Arbeitsteilige Spezialisierung; Rollen
Abstract	The combination of measuring performance and giving feedback creates tension between formative and summative purposes of progress evaluations and can be challenging for supervisors. There are conflicting perspectives and evidence on the effects supervisor-trainee relationships have on assessing performance. The aim of this study was to learn how progress evaluations are used in postgraduate education with longitudinal supervisor-trainee relationships. Progress evaluations in a two-year community-pharmacy specialization program were studied with a mixed-method approach. An adapted version of the Canadian Medical Education Directives for Specialists (CanMEDS) framework was used. Validity of the performance evaluation scores of 342 trainees was analyzed using repeated measures ANOVA. Semi-structured interviews were held with fifteen supervisors to investigate their response processes, the utility of the progress evaluations, and the influence of supervisor-trainee relationships. Time and CanMEDS roles affected the three-monthly progress evaluation scores. Interviews revealed that supervisors varied in their response processes. They were more committed to stimulating development than to scoring actual performance. Progress evaluations were utilized to discuss and give feedback on trainee development and to add structure to the learning process. A positive supervisor-trainee relationship was seen as the foundation for feedback and supervisors preferred the roles of educator, mentor, and coach over the role of assessor. We found that progress evaluations are a good method for directing feedback in longitudinal supervisor-trainee relationships. The reliability of scoring performance was low. We recommend progress evaluations to be independent of formal assessments in order to minimize roles-conflicts of supervisors. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01