Development and Validation of the Intervention Skills Profile-Skills: A Brief Measure of Student Social-Emotional and Academic Enabling Skills

Autor/inn/en	Kilgus, Stephen P.; Bonifay, Wes E.; Eklund, Katie; von der Embse, Nathaniel P.; Peet, Casie; Izumi, Jared; Shim, Hyejin; Meyer, Lauren N.
Titel	Development and Validation of the Intervention Skills Profile-Skills: A Brief Measure of Student Social-Emotional and Academic Enabling Skills
Quelle	(2020), (74 Seiten) PDF als Volltext (1); PDF als Volltext kostenfreie Datei (2) Verfügbarkeit
Zusatzinformation	ORCID (Kilgus, Stephen P.) Weitere Informationen
Sprache	englisch
Dokumenttyp	gedruckt; online; Monographie
Schlagwörter	Test Construction; Test Validity; Intervention; Rating Scales; Interpersonal Competence; Academic Ability; Test Items; Goodness of Fit; Emotional Intelligence; Elementary School Teachers; Elementary School Students; Accuracy; Classification; Scores; Social Skills Improvement System Rating Scales + Suchen Sie Ihr Suchwort? Testaufbau; Testvalidität; Rating-Skala; Interpersonale Kompetenz; Test content; Testaufgabe; Emotionale Intelligenz; Elementary school; Teacher; Teachers; Grundschule; Volksschule; Lehrer; Lehrerin; Lehrende; Classification system; Klassifikation; Klassifikationssystem
Abstract	The purpose of this study was to support the development and initial validation of the Intervention Selection Profile (ISP)-Skills, a brief 14-item teacher rating scale intended to inform the selection and delivery of instructional interventions at Tier 2. Teacher participants (n = 196) rated five students from their classroom across four measures (total student n = 877). These measures included the ISP-Skills and three criterion tools: Social Skills Improvement System (SSIS), Devereux Student Strengths Assessment (DESSA), and Academic Competence Evaluation Scales (ACES). Diagnostic classification modeling (DCM) suggested an expert-created Q-matrix, which specified relations between ISP-Skills items and hypothesized latent attributes, provided good fit to item data. DCM also indicated ISP-Skills items functioned as intended, with the magnitude of item ratings corresponding to the model-implied probability of attribute mastery. DCM was then used to generate skill profiles for each student, which included scores representing the probability of students mastering each of eight skills. Correlational analyses revealed large convergent relations between ISP-Skills probability scores and theoretically-aligned subscales from the criterion measures. Discriminant validity was not supported, as ISP-Skills scores were also highly related to all other criterion subscales. Receiver operating characteristic (ROC) curve analyses informed the selection of cut scores from each ISP-Skills scale. Review of classification accuracy statistics associated with these cut scores (e.g., sensitivity and specificity) suggested they reliably differentiated students with below average, average, and above average skills. Implications for practice and directions for future research are discussed, including those related to the examination of ISP-Skills treatment utility. [This paper was published in "Journal of School Psychology" 2020.] (As Provided).
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01