California Study Questions Validity of Gains Under NCLB

By Sean Cavanagh — July 11, 2006 4 min read
  • Save to favorites
  • Print

Student progress in reading has stagnated and in some cases declined since the passage of the No Child Left Behind Act, says a study released last week that examines test scores in a dozen states and finds that their gains are often exaggerated as a result of overly easy exams.

The report, issued by researchers at three universities in California, compares 4th graders’ reading and math scores on individual, state-designed assessments with those on the National Assessment of Educational Progress.

“Is the No Child Left Behind Act Working? The Reliability of How States Track Achievement” is posted by Policy Analysis for California Education.

The study points to the disparities between the percentage of students many of those states deem to be at least “proficient” in reading and math and those achieving that distinction on NAEP.

The study also found that states made stronger average annual gains in reading on the NAEP in the decade before the No Child Left Behind law took effect, in 2002.

Which Scores to Trust

States were more successful in sustaining their progress in math after the far-reaching, 4½-year-old law took effect, the study found, though their NAEP gains were more modest than those reported on individual state tests.

The report, “Is the No Child Left Behind Act Working? The Reliability of How States Track Achievement,” was released by Policy Analysis for California Education, or PACE, a research center affiliated with the University of California’s Berkeley and Davis campuses and Stanford University.

“Testing was sold to parents and the public as a way to tell whether student achievement was going up or down,” Bruce Fuller, a UC- Berkeley professor of education and one of the report’s authors, said in an interview. “Parents and policymakers and journalists should not trust state test-score results. They should place them alongside national test-score results.”

Valerie L. Smith, a spokeswoman for the U.S. Department of Education, disputed the report’s findings, noting recent progress in nationwide NAEP reading scores, especially among minority students. She noted that No Child Left Behind requires states to participate in NAEP as a way to ensure that states are held to account.

“The fact that state scores have risen more quickly than NAEP scores does nothing to diminish the gains we have seen on both state and NAEP [tests],” Ms. Smith said in a statement.

States craft their own tests in reading and math, which, under the provisions of the federal law, must be given annually in grades 3-8, and at least once in high school. Schools and districts that do not make adequate yearly progress face penalties.

How Proficient?

The content and rigor of state tests vary widely, however. To get a true sense of student academic progress across states, federal officials and researchers often turn to the congressionally mandated NAEP, which bills itself as the only nationally representative and continuing sample of student knowledge in various subjects. While almost all students are required to take their states’ assessments, NAEP, often called “the nation’s report card,” tests only a sample of students within states.

State tests and the national assessment judge student scores at different achievement levels. But the PACE study concludes that states set the bar much lower than NAEP does in determining whether students reach at least the “proficient” level.

On average, the proportion of 4th graders considered at least proficient in reading was 35 percentage points higher on the 12 states’ tests than on NAEP. In math, the proportion of students who reached the proficient level was 36 percentage points higher on the state exams than on NAEP.

Some states’ results suggested their achievement levels are relatively close to the NAEP standard, the study found. In Massachusetts, the proportion of 4th graders reaching proficiency in reading was only 10 percentage points higher than that of NAEP, and the gap in math was only 1 point.

One of the states in the study with the largest disparity between its scores and the NAEP is Texas. The percentage of 4th graders considered at least proficient in reading on the Texas state assessment was 55 percentage points higher than on NAEP, and in math, it was 51 points higher than on the national assessment.

Deborah Graves Ratcliffe, a spokeswoman for the Texas Education Agency, said Texas students were more likely to achieve a proficient score on the state assessment because standards and classroom lessons were designed to prepare them for that exam. NAEP is designed independently, rather than adhering to the math and reading content offered in any single state.

“We know our test is based on our standards and does a good job of testing what’s taught in our schools,” Ms. Ratcliffe said. “NAEP is not on the radar screen for a lot of our students.”

A version of this article appeared in the July 12, 2006 edition of Education Week as California Study Questions Validity of Gains Under NCLB


Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Reading & Literacy Webinar
Science of Reading: Emphasis on Language Comprehension
Dive into language comprehension through a breakdown of the Science of Reading with an interactive demonstration.
Content provided by Be GLAD
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Assessment Sponsor
Fewer, Better Assessments: Rethinking Assessments and Reducing Data Fatigue
Imagine a classroom where data isn't just a report card, but a map leading students to their full potential. That's the kind of learning experience we envision at ANet, alongside educators
Content provided by Achievement Network
Superintendent Dr. Kelly Aramaki - Watch how ANet helps educators
Photo provided by Achievement Network
Assessment Opinion What's the Best Way to Grade Students? Teachers Weigh In
There are many ways to make grading a better, more productive experience for students. Here are a few.
14 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
Assessment Spotlight Spotlight on Assessment
This Spotlight will help you evaluate effective ways to offer students feedback, learn how to improve assessments for ELs, and more.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Assessment Whitepaper
Understanding 'Through-Year' Assessment: What Everyone Should Know
This is a once-in-a-generation opportunity to reconsider our assessment systems. Discover a fresh approach with Through-Year Assessment.
Content provided by New Meridian