Multilevel Psychometric Analysis of the Instructional Pedagogical and Instructional Student Engagement Components of Fidelity of Implementation

• In Event: 31.092 - Poster Session 5
  In Poster Session: 31.092-1 - Methodological Approaches to Program Evaluation in the Schools

Abstract

To assess whether a program/intervention has been implemented as intended, assessment of fidelity is needed. However assessing fidelity is complex and methods for validating fidelity measures are still unclear. This study evaluated the reliability and validity of a treatment fidelity measure using a multilevel framework. The sample consisted of responses from students and teachers in Mathematics and Science across 3 school districts and 41 schools to an online questionnaire. Support for the factorial validity of the multilevel student models was mixed, with model fit indicating that some of the measured variables did not load strongly on their respective factors and some of the factors lacked discriminant validity. Lastly, the correlations between students’ and teachers’ scores displayed limited convergent validity.

Authors

• Sandra Naoom, University of South Florida

• Robert F. Dedrick, University of South Florida