2nd Generation Multi-Country Project Implementation Monitoring System: What have we learned about implementation fidelity, program quality and reading outcomes?

• In Event: The relationship between fidelity of implementation and learning: what the data tells us

Proposal

Leveraging data across eight South and South East Asian countries, this presentation explores the relationship between fidelity of implementation of reading interventions, the quality of delivery and reading outcomes. The analysis is based on data from a 2nd generation implementation monitoring system that has been implemented across ten countries in Asia and Africa. The system provides real-time data on the frequency and quality of program visits and activities, allowing field staff to prioritize their support to teachers and schools. Fidelity of implementation data are collected on a continual basis and reviewed monthly by country and global-level operational teams to assess alignment with implementation standards, creating data-driven strategies to improve program efficiency and quality.

Classroom observation data that include assessments of teachers on a continuum of skills will be presented and discussed with a focus on the relationship between implementation of coaching and changes in teacher instructional quality and pedagogical competencies. Parameters for the teacher instructional assessment are aligned with best practice in early grade literacy instruction and curricula.

Additionally, correlation and regression analyses are used with reading outcomes as the dependent variable and program input and outputs as predictors to explore the relationship between fidelity of implementation and reading outcomes. Discussion of strategies for data utilization by teachers in the classroom will be reviewed with data on teacher uptake of these utilization strategies.

Author

• Pinaki Joddar, Room to Read