A Statewide Evidence-Based Decision-Making Model that Informs Colorado’s Early Learning Investments

• In Event: AERA Roundtable Session Saturday 11:40 am Four Seasons Ballroom 4
  In Roundtable Session: Research to Action: Collaborating With State Education Agencies to Support High-Quality Early Learning (Table 13)

Abstract

Purpose & Perspective
State agencies are regularly tasked with defending the effectiveness of their many programs and investments while not having the resources or in-house expertise to design or conduct rigorous evaluations. An added challenge is that many policymakers are not experts at assessing whether a program’s evidence is sufficient to warrant continuation of investments and programs. This presentation will first provide an overview of a researcher-state government partnership that has resulted in an Evidence-Based Decision-Making (EBDM) model for Colorado (Colorado Evaluation and Action Lab, University of Denver, 2023). The presentation will then showcase how this research-government partnership has been used to support evidence building for the Colorado Department of Early Childhood’s stimulus investments, including a specific example of an early childhood stimulus-funded strategy that went through the EBDM process. The presenter will provide a brief overview of lessons learned from the stimulus work that has enhanced this partnership model for future collaborations, including an evidence-building parentship for the state’s new Universal Preschool Program.

Methods & Data Sources
The presentation will describe the evidence portfolio method used to implement EBDM in Colorado’s Department of Early Childhood and provide an example of this approach in action. The evidence-portfolio building process includes:
• Assessment and Learning to understand all state programs/practices that are being considered in the legislative and budgeting process that require evidence.
• Orientation and Adaptation of the EBDM and evidence portfolio process to ensure it will work within the state agency’s organizational structures and processes.
• Completion of Evidence Portfolios to acquire the evidence related to the program/practice in a standardized and collaborative approach.
• Informed Decision Making to map the results from evidence portfolios to decision-making criteria, and then make transparent recommendations about what programs/practices should be requested for continued funding from the legislature.

Results & Significance
This work has shaped the Evidence-Based Designations for Budget Act (2024) that provides clear and actionable steps for policymakers and state agencies to embed EBDM throughout their legislative and budgeting processes. The Colorado Governor’s Office of State Planning and Budgeting has used the support of the researcher-state government partnership to develop clear guidance for state agencies about how they bring meaningful evidence into their budget requests to meet the expectations of this new EBDM legislation. The research team is now working with multiple state agencies to grow the capacity of Colorado to implement the evidence portfolio process. Lastly, the Colorado Department of Early Childhood continues to leverage the researcher-state government partnership to guide its evidence-building needs for other high-priority areas including the early childhood workforce and Colorado’s Universal Preschool Program. This work has significant potential to inform how researchers from other states work with their legislature and state agencies on a common understanding of EBDM and effective approaches for implementing it in a sustainable way.

Authors

• Whitney A. LeBoeuf, Colorado Evaluation and Action Lab

• Diana Schaack, University of Colorado - Denver