School Choice & Charters

Study: Charter Evaluations Have Room for Improvement

By Karla Scoon Reid — February 25, 2004 3 min read

Evaluating charter school performance continues to be an inexact science, but one that can be mastered when overseers have more resources to conduct thorough reviews, a national study released here last week concludes.

Even charter school authorizers with ragged evaluation systems manage to stumble into taking the “correct” action when it comes to weighing a charter school’s fate, the report says. And authorizers aren’t hesitant to close schools that require that drastic step.

Read “High-Stakes": Public Impact’s National Study of Charter School Accountability,” from Public Impact.

“The decisions ultimately come out correctly, but not on the basis of the kind of process we would like to see,” said Bryan C. Hassel, a co-author of “High-Stakes: Findings From a National Study of Life-or-Death Decisions by Charter School Authorizers.”

Mr. Hassel, the president of Public Impact, a Chapel Hill, N.C.-based education policy consulting firm, said he wanted to examine whether charter authorizers were shutting down schools that were not performing and how those decisions were being made. The Smith Richardson Foundation, of Westport, Conn., paid for the study, which is co-written by Meagan Batdorff, a consultant with Public Impact.

The study compiled 506 “high-stakes” decisions—renewing, not renewing, or revoking charter school contracts—made by charter authorizers nationwide in 2001. Using that list, 50 randomly selected cases were reviewed through interviews and analysis of documents and media accounts.

Among the study’s main findings was that roughly one out of six high-stakes decisions led to school closures. About 84 percent of the decisions were renewals, while 16 percent resulted in schools’ loss of their contracts.

Mr. Hassel, who presented his study at the Brookings Institution in Washington Feb. 18, believes the figures represent a “fairly high rate” of closure because most of the high-stakes decisions made were sound. In the 50 case studies, the researchers found that only one school was not closed despite signs of “underperformance,” while supporting evidence was not clear in the closures of four other schools.

The report adds that many charter authorizers based their decisions on inadequate information or had failed to develop clear expectations with the schools. In more than half the cases, authorizers did not make “merit based” comparisons of evidence and agreed-upon goals. Political pressure was more commonly apparent, it says, in charter school decisions made by local school boards.

The researchers recommend that states provide more money to strengthen charter authorizers’ evaluation capabilities. Attracting authorizers other than local school boards would be beneficial, they argue, because universities and state education agencies—which issue charters in some states—tend to develop better evaluation programs.

“If you’ve got a lot of schools to oversee, you can’t just do it on the back of an envelope,” Mr. Hassel said. “You have to develop a system and be more deliberate about it.”

New Bureaucracy?

Robin Lake, the associate director of the Center on Reinventing Public Education at the University of Washington in Seattle, says that authorizers should not expect more state funding until the evaluation process is improved.

Ms. Lake suggested during the Brookings Institution discussion that states set minimum standards for oversight. Authorizers should be randomly audited to ensure that they are conducting adequate reviews, she added.

Mark Cannon, the executive director of the National Association of Charter School Authorizers, balked at the notion of drafting state policies that provide evaluation guidelines for authorizers. The Alexandria, Va.-based group represents 50 authorizing bodies.

While the association encourages charter authorizers to use a rigorous review process, he said, more state compliance rules “could stifle the innovation that charter schools tend to promote.”

No one wants to create another publicly financed bureaucracy, said Tom Mooney, the president of the Ohio Federation of Teachers, an affiliate of the American Federation of Teachers. But Mr. Mooney, a chief critic of his state’s charter school system, said in a telephone interview that adopting state standards for charter authorizers could provide a better accountability process.

“Most people want safeguards of quality and safeguards of how money is being spent,” he said.

Related Tags:

Events

Jobs The EdWeek Top School Jobs Virtual Career Fair
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Teaching Live Online Discussion How to Develop Powerful Project-Based Learning
How do you prepare students to be engaged, active, and empowered young adults? Creating a classroom atmosphere that encourages students to pursue critical inquiry and the many skills it requires demands artful planning on the
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
A Safe Return to Schools is Possible with Testing
We are edging closer to a nationwide return to in-person learning in the fall. However, vaccinations alone will not get us through this. Young children not being able to vaccinate, the spread of new and
Content provided by BD

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School Choice & Charters In Fight Over Millions of Dollars for Charter Schools, a Marijuana Tax May Bring Peace
The Oklahoma State Board of Education voted unanimously to rescind a polarizing lawsuit settlement, pending certain stipulations.
Nuria Martinez-Keel, The Oklahoman
3 min read
Money bills cash funds close up Getty
Getty
School Choice & Charters Full-Time Virtual Schools: Still Growing, Still Struggling, Still Resisting Oversight
Nearly 500,000 students now attend full-time online and blended schools, says a new report from the National Education Policy Center.
6 min read
Student attending class from a remote location.
E+
School Choice & Charters Opinion Is Hybrid Home Schooling the Future of Education?
Rick Hess speaks with Mike McShane about hybrid home schooling, which combines the best of home schooling and traditional schooling.
7 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
School Choice & Charters Oklahoma Charter Schools Granted Local Tax Revenue in 'Seismic' Settlement
A groundbreaking settlement will fundamentally change the way charter schools are funded in Oklahoma, despite vehement opposition.
Nuria Martinez-Keel, The Oklahoman
3 min read
This July 19, 2019 photo shows an Epic Charter Schools office in Oklahoma City. The Oklahoma State Board of Education voted Thursday in favor of an agreement with the state's public charter school association to settle a 2017 lawsuit.
This July 19, 2019 photo shows an Epic Charter Schools office in Oklahoma City. The Oklahoma State Board of Education voted Thursday in favor of an agreement with the state's public charter school association to settle a 2017 lawsuit.
Sue Ogrocki/AP