Paper Summary
Share...

Direct link:

Charter Accountability: High-Stakes Decisions Informed Using Value-Added Data

Mon, April 7, 8:15 to 9:45am, Convention Center, Floor: 100 Level, 117

Abstract

Purpose

The purpose of this study was to understand the changing use and impact of value-added data throughout the decision-making process for charter school review, renewal, and revocation by a state board for charter schools. The use of these data has evolved, since 2010, from a longitudinal analysis of growth and proficiency to a complex analysis using multiple measures from a single year.

Perspectives

Researchers in this study examined the decisions made by the State Board for Charter Schools that were based on value-added data. The Board’s newly adopted Academic Performance Framework was created in partnership with the National Association of Charter School Authorizers (NACSA) and serves as a modified version of the national model framework (State Board Charter Schools, 2012). The Framework is produced annually using multiple indicators of student achievement (Betebenner, 2008); each indicator is weighted depending on the school classification (SBCS, 2012) to calculate points by indicator (see Figure 1).

Methods

Researchers utilized a mixed methods approach, which included content analysis (Hsieh & Shannon, 2005; Patton, 2002) to analyze meeting minutes and records. Additionally, correlational analyses were conducted to analyze accountability data and outcomes. Board actions during 2012-2013 were analyzed to determine the extent to which the Board’s decisions were based on value-added evidence. Researchers also analyzed these data alongside previous accountability results for 2011-2012 to determine how the changes made to the Board’s accountability models impacted the number of schools identified for sanctions (Author(s), 2013). All data were obtained directly from the Board’s staff or were publicly available.

Results

Analyses evidenced that the use of value-added data resulted in the majority 55% (N=76/137) of charter schools evaluated being placed on academic probation, based on their failure to meet the Board’s academic expectations in the current or prior year (see Table 1). These data indicate that the Board is in fact making high-stakes decisions, in accordance with their policies and procedures, which have significant impacts on charter school quality and operations. Further analyses to be included in the final paper compared results using the state model to results from the Board’s reviews and decisions.

Significance

This research contributes directly to existing school accountability literature as well as provides support to policy makers and agencies during the development and revision of future accountability models. Findings from this study demonstrate the impact of high-stakes accountability decisions on school autonomy, as well as evidence that value-added data do contribute to the high-stakes accountability decisions made for charter schools. Likewise, results demonstrate that value-added data have a significant impact on the accountability decisions of the Board in this particular state.

Based on actions taken during the 2012-13 year, charter operators were overwhelmingly required to develop comprehensive school improvement plans and were subject to increased scrutiny and oversight. These sanctions, enforced by the Board, were intended to force behaviors at the school level to improve student learning, as evidenced by increased value-added scores, or face further, more punitive actions by the Board. It seems, as evidenced, this is occurring as planned.

Author