NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED611767
Record Type: Non-Journal
Publication Date: 2020
Pages: 74
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Development and Validation of the Intervention Skills Profile-Skills: A Brief Measure of Student Social-Emotional and Academic Enabling Skills
Kilgus, Stephen P.; Bonifay, Wes E.; Eklund, Katie; von der Embse, Nathaniel P.; Peet, Casie; Izumi, Jared; Shim, Hyejin; Meyer, Lauren N.
Grantee Submission
The purpose of this study was to support the development and initial validation of the Intervention Selection Profile (ISP)-Skills, a brief 14-item teacher rating scale intended to inform the selection and delivery of instructional interventions at Tier 2. Teacher participants (n = 196) rated five students from their classroom across four measures (total student n = 877). These measures included the ISP-Skills and three criterion tools: Social Skills Improvement System (SSIS), Devereux Student Strengths Assessment (DESSA), and Academic Competence Evaluation Scales (ACES). Diagnostic classification modeling (DCM) suggested an expert-created Q-matrix, which specified relations between ISP-Skills items and hypothesized latent attributes, provided good fit to item data. DCM also indicated ISP-Skills items functioned as intended, with the magnitude of item ratings corresponding to the model-implied probability of attribute mastery. DCM was then used to generate skill profiles for each student, which included scores representing the probability of students mastering each of eight skills. Correlational analyses revealed large convergent relations between ISP-Skills probability scores and theoretically-aligned subscales from the criterion measures. Discriminant validity was not supported, as ISP-Skills scores were also highly related to all other criterion subscales. Receiver operating characteristic (ROC) curve analyses informed the selection of cut scores from each ISP-Skills scale. Review of classification accuracy statistics associated with these cut scores (e.g., sensitivity and specificity) suggested they reliably differentiated students with below average, average, and above average skills. Implications for practice and directions for future research are discussed, including those related to the examination of ISP-Skills treatment utility. [This paper was published in "Journal of School Psychology" 2020.]
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: Elementary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Social Skills Improvement System Rating Scales
IES Funded: Yes
Grant or Contract Numbers: R305A180515
Author Affiliations: N/A