Assessment of Training Effectiveness Adjusted for Learning (ATEAL) Part II: Practical Application

Autor/inn/en	Samuel, Thomas; Azen, Razia; Campbell-Kyureghyan, Naira
Titel	Assessment of Training Effectiveness Adjusted for Learning (ATEAL) Part II: Practical Application
Quelle	In: Journal of Education and Learning, 9 (2020) 5, S.134-150 (17 Seiten) PDF als Volltext kostenfreie Datei Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1927-5250
Schlagwörter	Instructional Effectiveness; On the Job Training; Program Evaluation; Evaluation Methods; Safety Education; Pretests Posttests; Prior Learning; Utilities; Employees + Suchen Sie Ihr Suchwort? Unterrichtserfolg; Training-on-the-Job; Programme evaluation; Programmevaluation; Sicherheitserziehung; Vorkenntnisse; Hilfsmittel; Employee; Arbeitnehmer; Beschäftigter
Abstract	Safety training programs are a popular method, in industry globally, to increase awareness of risks to employees and employers and plays a critical part in reducing safety incidents. The most frequently used method to assess the effectiveness of the training is to have the participants answer Multiple Choice Question (MCQ) and True/False (T/F) questions after the training. The metrics used to report the outcome of the assessments have drawbacks that make it difficult for the trainer and organization to easily identify the concepts that need more focus and those that do not. The goal of this research study is to compare how the methods used to measure training effectiveness of concepts in Level 2 post training assessment differ in how they assess training effectiveness using actual training results. Pre- and Post-training assessments were administered to the participants in 3 different utility industries and were analyzed for training effectiveness using the traditional metrics as well as using ATEAL method. The results were then compared and detailed recommendations of the best and least learned concepts by industry are presented based on these comparative analyses. The ATEAL method is further used to quantify the opportunities for improvement in the training programs based on the participant prior knowledge and any negative training impact observed. Results of the comparison of the various methods show that the proposed ATEAL method provides a quick, accurate and easy way to assesses the effectiveness of the training of concepts and the method identified that for 40% of the concepts trained a higher percentage of participants exhibited more prior knowledge than positive learning and for 6% of the concepts a higher percentage exhibited negative training. These results also provide a directional guide on the improvements that can be made to improve the training effectiveness of the programs. Additionally, it also shows that the ATEAL method can be used in any learning environment where there is a pre-/post-test evaluation of the change and is not limited in application to MCQ and T/F questions. [For Part I, see EJ1270911.] (As Provided).
Anmerkungen	Canadian Center of Science and Education. 1120 Finch Avenue West Suite 701-309, Toronto, OH M3J 3H7, Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: jel@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/jel
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01