Assessment

‘Nation’s Report Card’ Remains Fodder for Charter Debate

By Caroline Hendrie — November 01, 2005 4 min read
  • Save to favorites
  • Print

With the recent release of this year’s results from “the nation’s report card,” supporters and critics of charter schools have renewed their debate over charter students’ relative performance, even while acknowledging serious limitations in the data’s reliability.

Charter school students’ scores appeared to be lower in most categories on the National Assessment of Educational Progress tests given this year to a national sample of 4th and 8th graders in reading and mathematics.

But average charter scores also closed most of the gap in 4th grade reading and narrowed it slightly in 4th grade math. That was enough for the National Alliance for Public Charter Schools, a Washington-based pro-charter advocacy group, to hail the scores as evidence of “real progress for charter schools.”

The American Federation of Teachers, which tangled with charter supporters repeatedly last year over earlier NAEP results, said the latest scores confirmed that “charter schools continue to lag behind regular public schools.”

Both sides agreed, though, that their conclusions were based, at least in part, on differences that the National Center for Education Statistics, the branch of the U.S. Department of Education that administers NAEP, does not regard as statistically significant. That is largely because of the relatively small number of charter students who were tested.

Yet researchers defended the effort to interpret scores from the congressionally mandated tests, which are seen as the most reliable national yardstick of student achievement in core subjects.

“Because the numbers are small, we’re probably not going to get statistical significance on charter gains,” said Bryan C. Hassel, a Chapel Hill, N.C.-based consultant who analyzed the NAEP results for the charter alliance. “So we have to look at the face-value numbers and then just be cautious about how we interpret them.”

Overall, the NAEP results, released Oct. 19, showed essentially flat scores or modest gains. (“NAEP Gains Are Elusive in Key Areas,” Oct. 26, 2005.)

The charter alliance cited 4th grade reading scores as particularly encouraging. Charter students’ average score on a 500-point scale rose from 212 in 2003 to 216 this year, a period when the average scale score for 4th graders in regular public schools stayed flat at 217.

When those figures were broken down by race and socioeconomic status, the average reading score for African-American 4th graders in charter schools rose 4 points to place them dead even with their black counterparts in noncharter schools, whose average rose only 2 points, to 199. The score for charter 4th graders eligible for federally subsidized lunches climbed by 8 points, to 203. That was the same as the average score for such students in regular public schools, which rose 2 points from 2003.

And the reading score for Hispanic 4th graders in charter schools jumped from 201 to 211, 10 points higher than for their noncharter counterparts, whose average rose just 2 points.

“Charter students and educators can be proud of these results,” Nelson Smith, the president of the charter-school alliance, said in a statement.

Reliability in Doubt

Both Mr. Hassel and Howard Nelson, an AFT researcher who analyzed the NAEP scores of charter students in 2003 and 2005, said just one of the apparent gains for charter students was considered statistically significant by the NCES: the 8-point rise in reading scores for 4th graders eligible for subsidized lunch.

Meanwhile, many of the differences in this year’s average scores between charter and noncharter students were not considered statistically significant, with some exceptions. Mr. Nelson said most of the statisically significant differences showed charter students scoring lower, including aggregate scores for grade 8 reading and math as well as grade 4 math.

And he defended the AFT’s use of the numbers. “We commented about charter and noncharter differences in 2003, and then again in 2005,” he said. “These differences are a little more likely to show statistical significance because there are so many more kids in the noncharter sample.”

One statistically significant gap in charter students’ favor was the 10-point spread in reading scores for Hispanic 4th graders, with charter students averaging 211 compared with 201 for their peers in other public schools.

The AFT touched off months of debate in August of last year with its analysis of NAEP scores from 2003, when the NCES tested an extra sample of charter school students. Some pro-charter researchers protested at the time that NAEP should not be used to draw conclusions about the performance of charter schools, which are public but largely independent of regular school districts. (“AFT Charter School Study Sparks Heated National Debate,” Sept. 1, 2004.)

One of those scholars, Paul T. Hill of the University of Washington, said last week that NAEP remains “a terrible tool” for comparing charter and noncharter public schools. “The data were never appropriate for the use they were put to,” said Mr. Hill, who directs the Seattle institution’s Center on Reinventing Public Education, “and they still aren’t.”

A version of this article appeared in the November 02, 2005 edition of Education Week as ‘Nation’s Report Card’ Remains Fodder for Charter Debate

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
The Future of the Science of Reading
Join us for a discussion on the future of the Science of Reading and how to support every student’s path to literacy.
Content provided by HMH
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
College & Workforce Readiness Webinar
From Classrooms to Careers: How Schools and Districts Can Prepare Students for a Changing Workforce
Real careers start in school. Learn how Alton High built student-centered, job-aligned pathways.
Content provided by TNTP
Mathematics K-12 Essentials Forum Helping Students Succeed in Math

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment What Teachers Really Think About State Testing
State testing remains a complicated debate amongst educators as the end-of-year assessments take place.
1 min read
A teacher points to a board as students listen in a fourth grade classroom at William Jefferson Clinton Elementary in Compton, Calif., on Feb. 6, 2025.
A teacher points to a board as students listen in a fourth grade classroom at William Jefferson Clinton Elementary in Compton, Calif., on Feb. 6, 2025. State testing happens every spring and educators share their thoughts on whether these assessments accurately reflect student learning.
Eric Thayer/AP
Assessment Download 6 Ways to Curb Grade-Change Requests From Students and Parents (DOWNLOADABLE)
No one likes dealing with grade-change requests. Here are some tips to help teachers avoid them altogether.
1 min read
Close up of a schoolgirl showing her C- grade on a test at elementary school.
E+/Getty Images
Assessment Opinion Our Grading System Was Setting Students Up to Fail—Until This Change
Our first reaction to standards-based grading was despair. Then, slowly, things began to change.
Matthew Ebert
5 min read
A student climbs up stairs as letter grades fall around her. In the background a teacher is grading a test.
Vanessa Solis/Education Week via Canva
Assessment In Case You Missed It: How Schools Are Measuring Student Success
Explore stories about grading practices, what truly reflects student achievement, and more.
5 min read
Grading and assessment SR
Robert Neubecker for Education Week