School & District Management

No Clear Edge for Charter Schools Found in 15-State Study

More Successes Seen in Charter Schools Serving Disadvantaged Students
By Lesli A. Maxwell — July 13, 2010 4 min read

Includes updates and/or revisions.

Students who won lotteries to attend charter middle schools performed, on average, no better in mathematics and reading than their peers who lost out in the random admissions process and enrolled in nearby regular public schools, according to a national study released late last month.

The federally commissioned study, involving 2,330 students who applied to 36 charter middle schools in 15 states, represents the first large-scale randomized trial of the effectiveness of charter schools across several states and rural, suburban, and urban locales. The charter schools in the sample conducted random lotteries for admissions, so that only chance determined who attended.

The study, conducted by Mathematica Policy Research, of Princeton, N.J., also concludes that the lottery winners did no better, on average, than the lottery losers on nonacademic outcomes such as behavior and attendance.

The findings on academic performance echo, in part, those of researchers at Stanford University, whose 2009 nonrandomized, multistate study of charter schools sparked fierce debate when they concluded that, in general, most charters were producing similar or worse achievement results for students than traditional public schools were.

The Mathematica authors add context to the new study’s findings, however, by exploring when charters seem to work best, and for which students. They found, for instance, that the charter middle schools serving the most economically disadvantaged students—especially those in urban areas—were more successful than their counterparts serving higher-achieving, more affluent students in producing gains in mathematics.

Parallel to KIPP

That finding is similar to that of a recent study of 22 middle schools operated by the Knowledge Is Power Program, or KIPP, the nation’s largest charter-management organization. That study, also conducted by Mathematica, found that the KIPP students—most of whom were also poor and were members of ethnic- and racial-minority groups—outperformed their peers in regular public schools.

People involved in the new study cautioned, though, against drawing any sweeping conclusions about the overall impact of charter schools on student achievement.

“There’s a wide variation in both math and reading impacts, as well as other measures,” said Marsha Silverberg, who oversaw the study as a project officer at the Institute of Education Sciences, the research arm of the U.S. Department of Education.

“Generally, we found that these charter schools were more effective for more low-income, lower-achieving students,” Ms. Silverberg said, “and less effective for higher-income, higher-achieving students.

“We are not suggesting that charter schools serving lower-income and lower-achieving students would always be more effective,” she said, “but that they were more effective than the traditional public schools around them.”

The most positive overall impact that all of the charter schools in the study produced was on the satisfaction levels expressed by parents and students. Parents whose children had won lotteries to attend charters were 33 percent more likely to say the schools were excellent than parents whose children lost the lotteries and attended regular public schools.

The new study came out on the same day that charter leaders and advocates gathered for an annual national conference in Chicago and followed closely on the heels of the release of the KIPP study.

Debate over the impact of the nation’s 5,000 charter schools, which are publicly financed but largely autonomous, has heightened over the past year with calls from President Barack Obama and U.S. Secretary of Education Arne Duncan to expand and replicate charters that have succeeded in raising achievement among the poorest students.

That debate grew more heated after the 2009 release of the multistate study from Stanford, which was produced by the Center for Research on Education Outcomes, or CREDO. It was followed by findings of another Stanford researcher, Caroline M. Hoxby, who concluded the opposite. In her study, which also used lotteries to randomly assign students to either control or experimental schools, Ms. Hoxby found that charter schools in New York City yielded positive impacts on student achievement.

Unsettled Debate

“This is not going to settle the debate,” Jeffrey R. Henig, an education professor at Teachers College, Columbia University, said of the new study. “There are a lot of folks on both sides who are pretty committed to keeping the debate alive on these terms, but I think on the overall balance scale, this study adds weight to the side that is suggesting that simply talking about charters versus noncharters is a distraction. There needs to be much more nuance.”

The new study included only charter middle schools that had been in operation for at least two years, which Mr. Henig said would undermine past arguments from charter advocates who called for giving schools a chance to mature before measuring their impact.

Margaret E. Raymond, the director of CREDO and the lead author of the study that it released last year, said the new results are “not surprising.”

“This is another layer of evidence that points to the wide variations in the charter school community and highlights, once again, that policy and context really matter,” she said. “I think what we really have to do now is get under the hood and find out more about how charters differ and why.”

Researchers involved in the new study did not disclose the states and communities where the study schools are located.

On average, though, those schools enrolled a lower percentage of low-income pupils than charters nationally, and served smaller percentages of low-achieving students than their national peers.

Also, the percentage of African-American students who attended the charter schools in the study was smaller compared with charters nationally.

A version of this article appeared in the July 14, 2010 edition of Education Week as No Clear Edge for Charter Schools Found in 15-State Study

Events

Classroom Technology Webinar Making Big Technology Decisions: Advice for District Leaders, Principals, and Teachers
Educators at all levels make decisions that can have a huge impact on students. That’s especially true when it comes to the use of technology, which was activated like never before to help students learn
Professional Development Webinar Expand Digital Learning by Expanding Teacher Training
This discussion will examine how things have changed and offer guidance on smart, cost-effective ways to expand digital learning efforts and train teachers to maximize the use of new technologies for learning.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
The Social-Emotional Impact of the Covid-19 Pandemic on American Schoolchildren
Hear new findings from an analysis of our 300 million student survey responses along with district leaders on new trends in student SEL.
Content provided by Panorama

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Opinion One Simple Way for Principals to Boost Students’ Unfinished Learning
Instruction improves when teachers remain in their current grades, write researchers Heather C. Hill and Susanna Loeb.
5 min read
Conceptual illustration of people running around a career track.
Vanessa Solis/Education Week and Getty Images
School & District Management Opinion How Did Ed. Leaders Decide Whether to Reopen Schools In Person Last Fall?
As school leaders face tough reopening decisions amid Delta variant concerns, we must understand how those decisions were made last year.
Douglas N. Harris & Katharine O. Strunk
4 min read
Protesters rally outside the San Diego Unified School District headquarters demanding that schools reopen for in-person learning and that voters oust some of the sitting school board members on Oct. 27, 2020 in San Diego.
Protesters rally outside the San Diego Unified School District headquarters demanding that schools reopen for in-person learning and that voters oust some of the sitting school board members on Oct. 27, 2020 in San Diego.
Sam Hodgson/The San Diego Union-Tribune via TNS
School & District Management Opinion Schools Faced a Massive Systems Failure During the Pandemic. How Do We Fix It?
Education leaders can (and must) find common purpose in the face of COVID-19, writes one superintendent.
Laura Kagy
2 min read
Hands hold up gears together.
Vanessa Solis/Education Week and Getty Images
School & District Management 4 Ways to Keep Staff and Students Safe From the Delta Variant
Just as schools reopen, a super-contagious COVID-19 variant is infecting people nationwide at alarming rates. Here's what schools can do.
5 min read
Students and parents walk into school on the first day of school at Enrique S. Camarena Elementary School on July 21, 2021, in Chula Vista, Calif.
Students and parents walk into school on the first day of school at Enrique S. Camarena Elementary School on July 21, 2021, in Chula Vista, Calif.
Denis Poroy/AP