School Choice & Charters

Charters Show “Slow and Steady Progress,” Multistate Study Finds

By Katie Ash — June 25, 2013 7 min read
  • Save to favorites
  • Print

UPDATED

Charter school students are outpacing their peers in regular public school districts in reading and performing at about the same level as traditional public school students in math, according to a new multistate study by Stanford University’s Center for Research on Education Outcomes.

The study, which analyzes charter school performance in 25 states, the District of Columbia, and New York City, found that students attending charter schools gain an additional eight days of learning in reading over the course of a year compared to regular public school students. Charter school students experience about the same amount of learning gains in math as their regular public school peers do.

Both findings indicate an upward trend in performance for charter school students, when compared with the research center’s 2009 survey, which looked at charter school student performance in 16 states and found that those schools lagged behind their regular public school counterparts in both reading and math.

In the 2009 study, 17 percent of charter schools outperformed their regular public school counterparts in math, about half showed no difference, and more than a third (37 percent) performed worse. In contrast, the new study shows that a quarter of charter schools outperformed regular public school districts in reading, and 29 percent of charters outperformed their local districts in math, while only 19 percent performed significantly worse in reading and 31 percent performed significantly worse in math. That shift represents a significant turnaround for charter school performance compared to the showing of students in regular public schools.

“There’s been slow and steady progress in the charter schools, but there still remains more to be done,” said Devora Davis, a research manager at CREDO, in an interview.

The report noted that there are significant numbers of charter schools that are “either substantially worse than the local alternative or are insufficient to give their students the academic preparation they need to continue their education or be successful in the workforce.”

Progress Through Closures?

The study also looked specifically at the 16 states studied in the 2009 report and found that overall, charters in those states experienced academic gains in both reading and math. Researchers attribute those gains to both the closures of low-performing charter schools as well as an overall decline in performance of the regular public schools.

Another difference researchers saw since the 2009 study was that charter schools are educating more disadvantaged students than they were four years ago.

More than half of the charter school population—54 percent—live in poverty, a higher percentage than reported in the 2009 study. Charters are also educating more Hispanic students, although they still enroll a lower number of white and Hispanic students than regular public school districts. Charters enroll a higher percentage of African-American students than do regular public school districts.

More must be done to close low-performing charter schools and replicate the high performance of successful charters, the study says.

“We really want the positive performance in that growing number of charters to be looked at and find out how they can transfer what they do in terms of operating and instructional skills to other charters and public education in general,” said Davis, of CREDO. “We really think it’s time to start and do more of that transfer.”

Andy Smarick, a partner at Bellwether Education Partners, a Washington, D.C.-based nonprofit, said the study was evidence of the charter sector’s ability to constantly improve, particularly in certain states. Bellwether is a research and consulting organization, whose clients include charters, districts, and states.

“Chartering is a continuous improvement system,” he said. “If you do the process right, you’re going to see this kind of systemic effect.”

Some of the most valuable information from the study comes from the differences shown in charters’ performance by state, Smarick added. A common feature of the jurisdictions that fare well in the study—he cited the District of Columbia as an example—is that they have strong, independent authorizers, and do not simply “leave chartering in the hands of districts.”

Smarick, who has studied urban education, said the results should compel states to eliminate caps on the number of charters.

In the District of Columbia, for instance, where the study found that charters had made significant gains since 2009, “charters are approaching 50 percent [of the overall public school population] and getting better results than other schools,” he said. “It begs the question ‘why can’t we have 75 percent, 90 percent or even 100 percent?’ It forces you to ask ‘do we need to keep the district around?’”

Others were not convinced that the results were a reason for supporters of charter schools to celebrate.

Andy Maul, a fellow at the National Education Policy Center and an assistant professor of research and methodology at the University of Colorado, Boulder, said that overall effect sizes in the study showing differences in academic performance between charters and traditional public schools are “trivial in magnitude.” Backers of charters, he said, are “making a lot out of a little.”

The policy center has published numerous reports on charters, some of them critical of either those schools’ academic performance, or of the cost of operating high-performing ones.

Davis said charter school authorizers should tie schools’ applications to stricter assurances of quality and performance. More research must be done to determine which factors have the greatest impact on charter school performance, she said.

The Stanford researchers drew comparisons between charter school students’ and regular public school students’ performance through a “virtual-control method” in which charter school students were compared to “virtual twins” who attend regular public schools where the charter students would otherwise have been enrolled.

Virtual twins are chosen to match charter school students’ standardized-test scores, race and ethnicity, special-education considerations, free- or reduced-price lunch participation, English proficiency, grade level, and grade retention in order to provide a comparison between schools with similar characteristics.

‘Indistinguishable’ Differences?

Maul questioned the methodology of the report, saying that Stanford University researchers could have used more common research techniques, and arguing that the “virtual control” model used in the study warranted more scrutiny.

Ultimately, the study will join a “growing list of reports that show essentially no overall difference in test scores between students who attend charter and traditional public schools,” Maul told Education Week in an interview.

Similarly, the director of the National Education Policy Center, Kevin Welner, said in an e-mail that the study’s findings mirror the overall thrust of past research on charters.

“Test-score outcomes for the charter school sector are indistinguishable from the test-score outcomes of the public schools in general,” Welner said.

Policymakers and researchers would be wise to move beyond debates about comparing charters versus regular public schools, and shift to examining “how to improve both of these sectors,” Welner said, “starting with the basic realization that little will be accomplished by merely propping up charters, or by other changes in who runs schools. The most successful charter schools and the most successful non-charter public schools offer greater opportunities, resources and supports for students and teachers.”

Greg Richmond, president of the National Association of Charter School Authorizers, a Chicago-based organization that attempts to improve the quality of charters, said the study’s state-by-state analysis should allow the public and policymakers to dissect what kinds of policies for governing the sector work best.

“Rather than pretending that the differentiation doesn’t exist, and proclaiming that there’s some kind of national truth,” Richmond said, “we instead need to say we can now see and learn what’s happening where [charters are] doing well, and apply those lessons.”

Even in states where charter schools are underperforming, Richmond said he’s optimistic the study will provide a roadmap for improvement. In some of those states, he said, lawmakers have recently put in place tougher requirements on charters.

Richmond took note that the study found that 8 percent of charters are closing after failing to meet various standards. That’s a sign that many charters are being held accountable for academic performance, he argued, even if a greater number of ineffective schools need to be shut down.

“Charter schooling is getting better, but we’re not there yet,” he said.

Sean Meehan and Kevin Connors contributed to this report.

Related Tags:

A version of this news article first appeared in the Charters & Choice blog.