Teaching Profession

AFT Charter School Study Sparks Heated National Debate

By Debra Viadero — October 02, 2004 6 min read
  • Save to favorites
  • Print

A national report suggesting that charter school students lag behind their counterparts in regular public schools touched off a late-summer tempest among proponents and critics of charter schools.

The study, produced by the American Federation of Teachers and the subject of the lead story in The New York Times on Aug. 18, was made more controversial by its implicit suggestion that the U.S. Department of Education had tried to bury federal test data that reflect poorly on such schools.

See Also

Enrolling 800,000-plus children in 38 states, charter schools are public schools that operate outside the bounds of school district authority—often in exchange for guarantees of improved academic achievement. They are a favored education improvement strategy of the Bush administration, which supports them with grants and a Web site. The federal No Child Left Behind Act also points to charter schools—now numbering about 3,000—as an important option for children in schools that fail to improve test scores.

Federal education officials, for their part, denied they had held back any data on charter schools, and they joined in a barrage of criticism of the AFT report.

In addition, an ad hoc group of 31 academics last week signed on to a full-page advertisement in The New York Times disputing the union’s report. The Aug. 25 ad was paid for by the Center on Education Reform, a Washington-based group that supports the charter movement.

Read the full report “Charter School Achievement on the 2003 National Assessment of Educational Progress,” from the American Federation of Teachers.

See also the North Carolina study, “The Impacts of Charter Schools on Student Achievement,” from Professor Helen F. Ladd at Duke University. (Both reports require Adobe’s Acrobat Reader.)

But there was no denying that the study, the first to assess children’s progress in charter schools nationally on a common set of tests, had made a splash in the continuing national policy debate over alternatives to traditional public education.

“The yellow light is up for charter schools now,” said Priscilla Wohlstetter, a researcher from the University of Southern California, in Los Angeles, who has studied the startup schools. The study, she said, is “certainly a reason to make sure authorizers [of charter schools] use caution in doing their job.”

Other longtime observers of charter schools saw in the findings a harsher indictment of the rhetoric that has helped fuel the nationwide movement.

“This was all based on how market forces would improve education, and now we know we really have no evidence of that,” said Amy Stuart Wells, a sociology professor at Teachers College, Columbia University.

Delays Prompt Study

Once welcoming of charter schools, the AFT has grown critical of them in recent years. Its new analysis draws on data from the National Assessment of Educational Progress, a barometer of student achievement that is mandated by Congress. In 2003, for the first time, federal officials collected data on a nationally representative sample of 167 such schools as part of that assessment. They put the scores online in November, along with the regular state-by-state results.

But the Education Department never advertised the figures’ availability. In reports to the national board that sets policy for NAEP, officials said they planned instead to do a more finely grained analysis of the data and publish the findings in January 2004—a date that has since been moved to the end of this year.

The delay prompted union analysts to mine the data themselves. They found that 4th graders attending charter schools performed about half a year behind students in other public schools in reading and mathematics. In 8th grade, charter school students trailed in math, but for reading, the differences were not statistically significant.

Those patterns remained when researchers adjusted the numbers to account for the higher proportions of poor students who attend charter schools and for the fact that the schools are clumped in inner cities, where achievement is generally lower.

Students in charters and regular public schools scored about the same, however, after researchers controlled for differences in the racial makeups of the schools. Likewise, achievement gaps between poor students and their better-off peers were wide in both charter and traditional public schools, the report says.

“Once everyone quiets down and takes a good, hard look at this, I hope they’ll say, ‘Hey, we’ve got to do better here for the sake of the kids,’ ” said Bella Rosenberg, a co-author of the study and a special assistant to the president of the AFT.

Critics Fire Back

Criticism of the report came swiftly, though, from many quarters.

U.S. Secretary of Education Rod Paige, three national groups that support charter schools, various state charter school associations, and the Republicans who chair both of the congressional committees that oversee education called the findings misleading.

In addition, an ad hoc group of 31 academics last week signed on to a full-page advertisement in The New York Times disputing the union’s report. The Aug. 25 ad was paid for by the Center on Education Reform, a Washington-based group that supports the charter movement.

But another, more sophisticated study released amid the furor over the AFT report reinforced some of the union’s conclusions. That analysis, based on six years of test-score data gathered on 6,000 North Carolina schoolchildren who had been enrolled in both regular public schools and charter schools, concludes that the academic gains that those students made in charter schools were smaller than the gains they made in regular schools.

The study is being reviewed for publication in a peer-reviewed economics journal, but the authors, Robert F. Bifulco of the University of Connecticut in West Hartford and Helen F. Ladd of Duke University in Durham, N.C., released it last week to weigh in on the national debate.

The problem with the union study, its critics said, meanwhile, is that charter schools may start out with lower achievement because they attract students who are unhappy in their regular schools.

They also said the study drew on a too-small sample of schools—enrolling only about 1 percent of charter school students nationwide—and failed to distinguish long-standing charter schools from startups or to account for variations among charter schools.

“It’s wrong to think of charter schools as a monolith,” Secretary Paige said in a statement to the press. “There are schools for dropouts, schools for students who’ve been expelled, schools serving the most economically disadvantaged families.”

“For this to have taken on a life of its own,” Jeanne Allen, the Center for Education Reform’s president, said of the AFT study, “tells me there are politics at play, and some people are looking for bad news.”

A better way to measure charter schools’ impact may be to look at the gains students make, said Tom Loveless, a scholar at the Brookings Institution in Washington who has also studied such schools. His own 2003 study, looking at 569 schools in 10 states, suggests that, even though charter school students start out behind their peers in other public schools, their test scores rise faster.

“That’s a terrific argument to make,” countered Ms. Rosenberg of the AFT, “but I don’t hear anyone making it when the results come out for regular public schools.”

She also noted that the NAEP state-by-state assessments do not include special analyses to account for demographic and socioeconomic differences among states.

Still, Darvin M. Winick, the chairman of the National Assessment Governing Board, which sets policy for the national assessment, said he questions whether the AFT researchers should have based their conclusions on raw data from a limited pilot study.

In addition, he said he had no reason to suspect that the Education Department had held back findings.

Even so, he said, “you could argue—and I would not quarrel with you—that it would be better if all these reports [from the department] were more prompt.”

Related Tags:

A version of this article appeared in the September 01, 2004 edition of Education Week as AFT Charter School Study Sparks Heated National Debate

Events

Student Well-Being K-12 Essentials Forum Social-Emotional Learning: Making It Meaningful
Join us for this event with educators and experts on the damage the pandemic did to academic and social and emotional well-being.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
K-12 Cybersecurity in the Real World: Lessons Learned & How to Protect Your School
Gain an expert understanding of how school districts can improve their cyber resilience and get ahead of cybersecurity challenges and threats.
Content provided by Microsoft
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Trauma-Informed Schools 101: Best Practices & Key Benefits
Learn how to develop a coordinated plan of action for addressing student trauma and
fostering supportive, healthy environments.
Content provided by Crisis Prevention Institute

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession Opinion 11 Critical Issues Facing Educators in 2023
From health and safety to labor shortages, the coming year is rife with challenges for school leaders and teachers.
5 min read
shutterstock 513761242
Shutterstock
Teaching Profession 'Gaslighting' Is the Word of the Year. Did It Haunt Schools, Too?
The Merriam-Webster word of the year often intersected with schools and teachers in 2022.
3 min read
The highlighted word "Gaslighting" and showing part of its definition to include the word "manipulation" on a computer screen.
iStock/Getty Images Plus
Teaching Profession It's a Nasty Cold and Flu Season, But Some Educators Are Reluctant to Take Sick Days
Many cite the pile of work—and lost learning—that accumulates when they take time off.
6 min read
Sick woman holding tissues and drinking from a mug while working
iStock/Getty Images Plus
Teaching Profession In Their Own Words 'I Just Want to Get Better': A Teacher With Long COVID Retires Earlier Than She'd Hoped
A former Massachusetts teacher shares how long COVID damaged her cognitive abilities and accelerated her retirement.
5 min read
Betsy Peterson, a former K-5 technology teacher who was forced to retire early due to symptoms of long Covid, pictured in her home in Maynard, Mass., on November 21, 2022.
Betsy Peterson, a former K-5 technology teacher in Massachusetts, has been struggling with bureaucratic hurdles and debilitating symptom since contracting COVID at the start of the year.
Angela Rowlings for Education Week