Evaluating the Impacts of the Seattle Preschool Program

• In Event: Early Childhood Impacts

Abstract

Introduction
The City of Seattle's Seattle Preschool Program (SPP) provides preschool services to 3- and 4-year-olds throughout the city, partnering with a variety of child care providers. SPP aims to eliminate equity gaps in kindergarten readiness and provide equitable access to high-quality early learning. 

Research Questions
As part of the City's effort to understand the impact of its investment and engage in program improvement, our team conducted a mixed-methods impact evaluation of SPP. Our questions were: 

1. What is the impact of SPP participation on kindergarten readiness, grade 3 test scores in math and reading, and attendance rates?

2. How well does SPP prepare families and children for kindergarten?

Methods
We used administrative data from state agencies, Seattle Public Schools, and the City of Seattle on preschool and elementary school enrollment, demographics, and outcomes.We used a rigorous quasi-experimental design to estimate the impact of SPP on child-level outcomes. Specifically, we used a weighting design to compare outcomes for SPP children to similar non-SPP children based on preschool assessment data, race/ethnicity, family income, and language.

We conducted a short online survey of kindergarten families and engaged in family focus groups and interviews to understand family perspectives on kindergarten preparation. For the survey, we calculated descriptive statistics such as percentages and averages. For focus groups and interviews, we used inductive coding to derive themes.

Results
Among children with similar characteristics who attended SPP or state-funded preschool in 2017–18, children who attended SPP had higher attendance rates in kindergarten (1.9 percentage points higher) and higher kindergarten readiness scores (between 16 and 29 percentiles higher, depending on the domain) compared to similar children who attended state-funded preschool. The evaluation team also estimated the impact of SPP on grade 3 math and reading assessment scores. These scores were Smarter Balanced assessment (SBA) scores from grade 3 students in the 2021–22 school year who participated in SPP or state-funded preschool in the 2017–18 school year. Results indicate that SPP participation in 2017–18 had a significant and positive impact on grade 3 math and ELA assessment scores (0.6 standard deviations in math and 0.7 in ELA). Forthcoming analyses expected to be completed prior to APPAM will test this for more recent years of students and for different demographic groups.

Most families reported that SPP helped prepare them and their children for kindergarten. Many families received helpful information and support around kindergarten preparation from their preschool, and this varied by race/ethnicity, with a lower percentage of Black families reporting receiving this information. Families also reported that kindergarten registration was challenging to navigate.

Implications
SPP seems to have a positive impact on child outcomes when compared to a state-funded preschool program, but other analyses showed persistent equity gaps. We suggest enhancing SPP classroom supports to groups with equity gaps. Additionally, offering information and support for the kindergarten transition in a variety of ways at all SPP sites could help families feel more prepared.

Author

• Ashley B Pierson, American Institutes for Research (AIR)
  Presenting Author