Search
Program Calendar
Browse By Day
Browse By Time
Browse By Person
Browse By Room
Browse By Unit
Browse By Session Type
Browse By Descriptor
Search Tips
Annual Meeting Theme
Exhibitors
About Philadelphia
About AERA
Personal Schedule
Sign In
X (Twitter)
Success for All (SFA) is the most thoroughly evaluated elementary school reform in the country. In 2010, the Success for All Foundation (SFAF) received a scale-up grant under the Investing in Innovation (i3) initiative to replicate its flagship model, which combines a whole-school reform program with a reading program that centers on the use of cooperative learning methods in conjunction with a phonics-based curriculum. The i3 independent evaluation of SFA, conducted by MDRC, involves the random assignment of 37 schools located in five school districts in four states: 19 program group schools were randomly selected to operate SFA, while 18 control group schools are continuing with “business as usual.”
The first stage of the logic model describes inputs that include initial training before schools implement SFA and ongoing coaching thereafter. Key program components that fall under three rubrics – Schoolwide Structures, Classroom Processes, and Student Engagement – are captured through an instrument created by the program developers, the School Achievement Snapshot, on which SFA coaches receive extensive training and which they routinely use to measure implementation at the school level. Through interviews and program documents, coaches determine whether School-wide Structures (e.g., a 90-minute reading block, regular meetings to review data, a committee charged with improving attendance) are in place. SFA has developed detailed procedures for coaches to observe classrooms and assess whether they manifest the desired Classroom Processes (e.g., teachers providing time for cooperative learning activities) and Student Engagement (e.g. student talk equaling or exceeding teacher talk). The logic model also includes both intermediate outcomes (e.g., a more orderly environment) and longer-term outcomes (e.g., higher student achievement in reading).
MDRC’s evaluation of Success for All’s scale-up adopts this instrument for measuring implementation at the 19 program schools. The Snapshot was created, however, to pinpoint areas for more intensive work with schools on the part of the SFA coaches, rather than to rate implementation fidelity. Toward the latter end, MDRC and SFAF staff worked together to define a zero-100 rating scale that describes the extent to which each school is implementing SFA with fidelity. (The maximum first-year score is 66, because all program elements are not expected to be implemented then.)
At the AERA session, Janet Quint of MDRC will discuss first- and second-year implementation fidelity ratings as well as the extent to which evaluation data collected from other sources (e.g., teacher and principal surveys, interviews with SFA facilitators and school principals, teacher focus groups, and classroom activity logs) confirm, call into question, or otherwise shed light on these ratings. However, the extent to which SFA generates positive impacts in the i3 study depends not only on the extent to which it is executed faithfully at the program schools but also on the extent to which the SFA schools differ from the control schools. Accordingly, Quint will discuss MDRC’s use of the Snapshot to inform items contained in surveys administered to principals at both sets of schools. Robert Slavin of SFAF will describe how the instrument is used for program improvement.