Examining the Correspondence between Teacher- and Observer-Report Treatment Integrity Measures

Autor/inn/en	McLeod, Bryce D.; Sutherland, Kevin S.; Broda, Michael; Granger, Kristen L.; Cecilione, Jennifer; Cook, Clayton R.; Conroy, Maureen A.; Snyder, Patricia A.; Southam-Gerow, Michael A.
Titel	Examining the Correspondence between Teacher- and Observer-Report Treatment Integrity Measures
Quelle	In: School Mental Health, 14 (2022) 1, S.20-34 (15 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (McLeod, Bryce D.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1866-2625
DOI	10.1007/s12310-021-09437-7
Schlagwörter	Fidelity; Early Childhood Teachers; Intervention; Self Evaluation (Individuals); Measures (Individuals); Test Validity; Test Reliability; Evidence Based Practice; At Risk Students; Behavior Disorders; Emotional Disturbances + Suchen Sie Ihr Suchwort? Early childhood; Early childhood education; Teacher; Teachers; Frühe Kindheit; Frühkindliche Bildung; Frühpädagogik; Lehrer; Lehrerin; Lehrende; Messdaten; Testvalidität; Testreliabilität; Gefühlsstörung
Abstract	Teacher-reported measures of treatment integrity (the extent to which prescribed practices are delivered as intended by teachers) have the potential to support efforts to evaluate and implement evidence-based interventions in early childhood settings. However, self-report treatment integrity measures have shown poor correspondence with observer-report treatment integrity measures, raising questions about score validity. This paper reports on the development and initial evaluation of the score reliability and validity of the Treatment Integrity Measure for Early Childhood Settings Teacher Report (TIMECS-TR), which is designed to address limitations of previous self-report treatment integrity measures that may have contributed to low correspondence with observer-rated measures. The TIMECS-TR includes 24 items designed to represent practices found in evidence-based interventions delivered in early childhood settings that target child social, emotional, and behavioral skills, rather than adherence to practices found in a specific evidence-based intervention. Fifty-four teachers (92.6% female, 7.4% male; 61.1% White) completed the TIMECS-TR weekly for a total of 618 times (M = 6.79 per child; SD = 2.16; range 2 to 11) about the practices they delivered with 91 children (45.1% female, 54.9% male; M = 4.53 years old; SD = 45.1% Black) who were at risk for emotional and behavioral disorders. Analyses indicated that the TIMECS-TR items evidenced mild to moderate test-retest score reliability over one week. However, analyses did not support the convergent score validity of the TIMECS-TR items or scale with observational ratings of the same practices. Teachers reported higher levels of practice delivery on the TIMECS-TR items relative to observer report. Overall, our findings raise concerns about the accuracy of teacher-report adherence measures. Lessons from this research can be used to identify possible reasons for the low correspondence between teacher- and observer-report treatment integrity measures so that future research can strive to dependably capture teacher delivery of the practices found in evidence-based interventions. (As Provided).
Anmerkungen	Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01