Teaching Profession

AFT Charter School Study Sparks Heated National Debate

By Debra Viadero — October 02, 2004 6 min read
  • Save to favorites
  • Print

A national report suggesting that charter school students lag behind their counterparts in regular public schools touched off a late-summer tempest among proponents and critics of charter schools.

The study, produced by the American Federation of Teachers and the subject of the lead story in The New York Times on Aug. 18, was made more controversial by its implicit suggestion that the U.S. Department of Education had tried to bury federal test data that reflect poorly on such schools.

See Also

Enrolling 800,000-plus children in 38 states, charter schools are public schools that operate outside the bounds of school district authority—often in exchange for guarantees of improved academic achievement. They are a favored education improvement strategy of the Bush administration, which supports them with grants and a Web site. The federal No Child Left Behind Act also points to charter schools—now numbering about 3,000—as an important option for children in schools that fail to improve test scores.

Federal education officials, for their part, denied they had held back any data on charter schools, and they joined in a barrage of criticism of the AFT report.

In addition, an ad hoc group of 31 academics last week signed on to a full-page advertisement in The New York Times disputing the union’s report. The Aug. 25 ad was paid for by the Center on Education Reform, a Washington-based group that supports the charter movement.

Read the full report “Charter School Achievement on the 2003 National Assessment of Educational Progress,” from the American Federation of Teachers.

See also the North Carolina study, “The Impacts of Charter Schools on Student Achievement,” from Professor Helen F. Ladd at Duke University. (Both reports require Adobe’s Acrobat Reader.)

But there was no denying that the study, the first to assess children’s progress in charter schools nationally on a common set of tests, had made a splash in the continuing national policy debate over alternatives to traditional public education.

“The yellow light is up for charter schools now,” said Priscilla Wohlstetter, a researcher from the University of Southern California, in Los Angeles, who has studied the startup schools. The study, she said, is “certainly a reason to make sure authorizers [of charter schools] use caution in doing their job.”

Other longtime observers of charter schools saw in the findings a harsher indictment of the rhetoric that has helped fuel the nationwide movement.

“This was all based on how market forces would improve education, and now we know we really have no evidence of that,” said Amy Stuart Wells, a sociology professor at Teachers College, Columbia University.

Delays Prompt Study

Once welcoming of charter schools, the AFT has grown critical of them in recent years. Its new analysis draws on data from the National Assessment of Educational Progress, a barometer of student achievement that is mandated by Congress. In 2003, for the first time, federal officials collected data on a nationally representative sample of 167 such schools as part of that assessment. They put the scores online in November, along with the regular state-by-state results.

But the Education Department never advertised the figures’ availability. In reports to the national board that sets policy for NAEP, officials said they planned instead to do a more finely grained analysis of the data and publish the findings in January 2004—a date that has since been moved to the end of this year.

The delay prompted union analysts to mine the data themselves. They found that 4th graders attending charter schools performed about half a year behind students in other public schools in reading and mathematics. In 8th grade, charter school students trailed in math, but for reading, the differences were not statistically significant.

Those patterns remained when researchers adjusted the numbers to account for the higher proportions of poor students who attend charter schools and for the fact that the schools are clumped in inner cities, where achievement is generally lower.

Students in charters and regular public schools scored about the same, however, after researchers controlled for differences in the racial makeups of the schools. Likewise, achievement gaps between poor students and their better-off peers were wide in both charter and traditional public schools, the report says.

“Once everyone quiets down and takes a good, hard look at this, I hope they’ll say, ‘Hey, we’ve got to do better here for the sake of the kids,’ ” said Bella Rosenberg, a co-author of the study and a special assistant to the president of the AFT.

Critics Fire Back

Criticism of the report came swiftly, though, from many quarters.

U.S. Secretary of Education Rod Paige, three national groups that support charter schools, various state charter school associations, and the Republicans who chair both of the congressional committees that oversee education called the findings misleading.

In addition, an ad hoc group of 31 academics last week signed on to a full-page advertisement in The New York Times disputing the union’s report. The Aug. 25 ad was paid for by the Center on Education Reform, a Washington-based group that supports the charter movement.

But another, more sophisticated study released amid the furor over the AFT report reinforced some of the union’s conclusions. That analysis, based on six years of test-score data gathered on 6,000 North Carolina schoolchildren who had been enrolled in both regular public schools and charter schools, concludes that the academic gains that those students made in charter schools were smaller than the gains they made in regular schools.

The study is being reviewed for publication in a peer-reviewed economics journal, but the authors, Robert F. Bifulco of the University of Connecticut in West Hartford and Helen F. Ladd of Duke University in Durham, N.C., released it last week to weigh in on the national debate.

The problem with the union study, its critics said, meanwhile, is that charter schools may start out with lower achievement because they attract students who are unhappy in their regular schools.

They also said the study drew on a too-small sample of schools—enrolling only about 1 percent of charter school students nationwide—and failed to distinguish long-standing charter schools from startups or to account for variations among charter schools.

“It’s wrong to think of charter schools as a monolith,” Secretary Paige said in a statement to the press. “There are schools for dropouts, schools for students who’ve been expelled, schools serving the most economically disadvantaged families.”

“For this to have taken on a life of its own,” Jeanne Allen, the Center for Education Reform’s president, said of the AFT study, “tells me there are politics at play, and some people are looking for bad news.”

A better way to measure charter schools’ impact may be to look at the gains students make, said Tom Loveless, a scholar at the Brookings Institution in Washington who has also studied such schools. His own 2003 study, looking at 569 schools in 10 states, suggests that, even though charter school students start out behind their peers in other public schools, their test scores rise faster.

“That’s a terrific argument to make,” countered Ms. Rosenberg of the AFT, “but I don’t hear anyone making it when the results come out for regular public schools.”

She also noted that the NAEP state-by-state assessments do not include special analyses to account for demographic and socioeconomic differences among states.

Still, Darvin M. Winick, the chairman of the National Assessment Governing Board, which sets policy for the national assessment, said he questions whether the AFT researchers should have based their conclusions on raw data from a limited pilot study.

In addition, he said he had no reason to suspect that the Education Department had held back findings.

Even so, he said, “you could argue—and I would not quarrel with you—that it would be better if all these reports [from the department] were more prompt.”

Related Tags:

A version of this article appeared in the September 01, 2004 edition of Education Week as AFT Charter School Study Sparks Heated National Debate

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Teaching Profession The State of Teaching 'You Don't Know Teacher Tired': Educators Sound Off on Misconceptions
Hear what teachers featured in EdWeek's The State of Teaching Project say makes their jobs more difficult.
Frank Rivera teaches 7th grade ELA at Chaparral Star Academy in Austin, Texas, on Nov. 15, 2023.
Frank Rivera teaches 7th grade ELA at Chaparral Star Academy in Austin, Texas, on Nov. 15, 2023.
Montinique Monroe for Education Week
Teaching Profession Opinion Why I’m Happy Being ‘Just a Teacher’
Not every teacher is an aspiring administrator. That’s a good thing.
Amanda Myers
3 min read
Abstract vector illustration depicting the process of teaching and learning.
DigitalVision Vectors/Getty
Teaching Profession What the Research Says Do Teachers Really Earn More After Leaving the Classroom? Not Necessarily
Nearly a decade after leaving a big urban district, many teachers have yet to recoup income, a study finds.
4 min read
Illustration of woman and steps made of cash.
Getty
Teaching Profession The State of Teaching Here's What Keeps Teachers on the Job
Hear why these teachers stay in the job, despite its challenges and lower pay.
Fourth graders do a warm up dance at the beginning of Helen Chan's math class at South Loop Elementary School on November 15, 2023, in Chicago.
Fourth graders do a warm-up dance at the beginning of Helen Chan's math class at South Loop Elementary School on Nov. 15, 2023, in Chicago.
Jamie Kelter Davis for Education Week