School & District Management

New Data Fuel Current Charter School Debate

By Debra Viadero — September 21, 2004 3 min read
  • Save to favorites
  • Print

Debate over whether students do better or worse in charter schools raged on last week as a Harvard University researcher released new data suggesting that 4th graders in charter schools across the nation score higher on state exams than their counterparts at regular public schools nearby.

The new findings run counter to those put forward last month by the American Federation of Teachers. Analyzing unpublicized data from the National Assessment on Educational Progress, the teachers’ union found that charter school students lag behind their peers in other kinds of public schools on the national reading and mathematics exams.

That study drew heated criticism from policymakers, researchers, and charter school proponents, who called the findings misleading. (See “AFT Charter School Study Sparks Heated National Debate,” Sept.1, 2004.) The controversy also prompted Caroline M. Hoxby, the author of the new study, to make public data that paint a very different picture of charter school achievement.

“I thought if you’re going to do a simple comparison, that’s not the way to do it,” she said. “We should not prematurely judge these schools.”

Numbering 3,000 nationwide, charter schools are publicly funded schools that operate free of many school district rules. Favored by the Bush administration, they are also one of the options that failing schools face under the No Child Left Behind Act.

For her study, Ms. Hoxby, an economist, compared 4th grade scores on state-mandated reading and math exams in two sets of schools—charter schools and the closest regular public schools. The latter group, Ms. Hoxby reasoned, were the schools that charter school students would have most likely attended. When more than one such school was nearby, Ms. Hoxby chose the one with the most similar demographic makeup.

Methods Differ

Nationwide, she found, charter school students were 3 percent more likely than noncharter pupils to be proficient on their state’s reading exam and 2 percent more likely to reach proficient levels in mathematics. She said the results, though small, are statistically significant.

Caroline M. Hoxby

Ms. Hoxby said her method was better than the AFT’s because she included scores for almost every charter school in the country. The NAEP data, in comparison, were based on a nationally representative sample of students and included 167 charter schools.

But other researchers poked holes in Ms. Hoxby’s study.

“She’s right in raising the criticisms of the NAEP results, but it’s not at all clear that her study improves much on them,” said Helen F. Ladd, a public policy professor at Duke University in Durham, N.C.

Part of the problem, Ms. Ladd said, was that the nearest school may not always be the right comparison. She also faulted the study for relying on proficiency levels, which may be less exact than actual test scores.

Also, Ms. Ladd said, both studies suffer from the same flaw: They look at academic achievement at one point in time, rather than tracking students’ academic progress.

Change to U.S. Survey

Experts said the ongoing controversy points up the need for more and better data on charter schools.

Yet news also leaked out last week that the U.S. Department of Education has cut back on some of the information that it collects on charter schools.

The last round of data collection for the periodic federal report known as the Schools and Staffing Survey included information on only 300 schools. In comparison, the 2002 study surveyed all 1,010 such schools existing at the time.

“The Bush administration says their reforms are based on what science is saying—yet, in fact, they’re making it more difficult to do good work on charter schools,” said Bruce Fuller, the University of California, Berkeley, researcher who alerted the media to the cutback.

But Michael J. Petrilli, the department’s associate deputy undersecretary for innovation and improvement, said cost concerns drove the change, which was decided in 2001 or 2002.

He said federal officials also expect to get more definitive data on charter schools from a $5 million study that began this year. Looking at 50 such schools nationwide, the randomized study will compare charter students’ achievement over time with that of other public school pupils who failed to win charter school seats in the same lotteries.

Related Tags:


Student Well-Being K-12 Essentials Forum Boosting Student and Staff Mental Health: What Schools Can Do
Join this free virtual event based on recent reporting on student and staff mental health challenges and how schools have responded.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Curriculum Webinar
Practical Methods for Integrating Computer Science into Core Curriculum
Dive into insights on integrating computer science into core curricula with expert tips and practical strategies to empower students at every grade level.
Content provided by

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Late Arrivals, Steep Costs: Why Some Districts Ditch Third-Party Bus Companies
Districts are facing a host of transportation challenges. Some have addressed them by deciding to bring buses back in house.
6 min read
School buses parked in Helena, Mont., ahead of the beginning of the school year on Aug. 20, 2021.
Some districts are pulling back on decisions to outsource bus services in an effort to save money and improve service.
Iris Samuels/AP
School & District Management Rising Tensions From Israel-Hamas War Are Seeping Into Schools
As effects of the war reverberate in school communities, schools have federal responsibilities to create discrimination-free environments.
5 min read
People gather in Pliny Park in Brattleboro, Vt., for a vigil, Monday, Nov. 27, 2023, for the three Palestinian-American students who were shot while walking near the University of Vermont campus in Burlington, Vt., Saturday, Nov. 25. The three students were being treated at the University of Vermont Medical Center, and one faces a long recovery because of a spinal injury, a family member said.
People gather in Pliny Park in Brattleboro, Vt., for a vigil, Monday, Nov. 27, 2023, for the three Palestinian-American students who were shot while walking near the University of Vermont campus in Burlington, Vt., Saturday, Nov. 25. Tensions over the Israel-Hamas war are playing out in schools and colleges across the country, including some K-12 schools.
Kristopher Radder/The Brattleboro Reformer via AP
School & District Management The Missed Opportunity for Public Schools and Climate Change
More cities are creating climate action plans, but schools are often left out of the equation.
4 min read
Global warming illustration, environment pollution, global warming heating impact concept. Change climate concept.
Collage by Gina Tomko/Education Week and iStock/Getty Images Plus
School & District Management 13 States Bar School Board Members From Getting Paid. Here's Where It's Allowed (Map)
There are more calls to increase school board members' pay, or to allow them to be paid at all.
Two professional adults, with a money symbol.