Federal

Study Disputes ‘Plateau Effect’ in Test Scores

By Stephen Sawchuk — July 22, 2009 3 min read
  • Save to favorites
  • Print

One of the common beliefs about testing in the era of accountability hinges on the notion that student test scores improve rapidly in the first few years of a new testing program as teachers and students adjust, followed by a “plateau” in scores after the early gains.

The assertion underpins criticism of the federal No Child Left Behind Act, which requires states to raise scores regularly over a 12-year period.

But a new study, released yesterday, offers evidence that while this “plateau effect” in test scores does appear in some states, it is not pervasive across the nation.

“There’s as likely to be an increase or a decrease in scores as a plateau,” said Jack Jennings, the president of the Washington-based Center on Education Policy, a nonpartisan research group. “The idea that you always hit a plateau just isn’t true.”

The report is a companion to one released earlier this month that found state test scores appear to be improving across all proficiency levels in the wake of the federal NCLB law, which was enacted in early 2002. (“NCLB Found to Raise Scores Across Spectrum,” June 17, 2009.)

No Common Patterns

The new study examines 55 state test-score trends across 16 states. Each of the trend lines represents at least six years of test-score data between 1999 and 2008. None of the states studied changed those tests over that time period or lowered their “cut scores,” the number or percentage of questions students must answer correctly to be deemed “proficient.”

The concept of the plateau effect holds that the largest gains in test scores will appear in the earliest years of a testing program, as teachers drill students on the new item formats, and those students on the cusp of proficiency make gains. After districts have culled the “low-hanging fruit,” the thinking goes, it becomes more difficult to bump up the scores of students with learning challenges, and overall scores level off.

But the report found no widespread pattern of plateaus. Of the 55 trend lines studied, 15 exhibited a plateau. Twenty-one trend lines showed steady increases in the percentage of students scoring at the proficient level on the tests, while 19 states showed a zigzag pattern that, despite some downturns, indicated upward momentum overall.

The report complicates the research literature on plateaus: A number of earlier studies did find evidence of the phenomenon. Mr. Jennings surmised that some of those studies were conducted on state data from the 1980s and 1990s. In those years, before state and federal accountability regimes put a premium on using fresh test items each year, states commonly recycled questions, making it easier to prep students.

NCLB Effect?

The report also found that for a third of the trend lines studied, the greatest score gains were made in the 2003-04 period, during which testing under the NCLB law was fully established, suggesting that the higher stakes accompanying the federal law did cause districts and teachers to redouble efforts to raise scores.

“It’s pretty hard to look at that and not think that NCLB had an effect,” Mr. Jennings said.

Bruce Fuller, a professor of education and public policy at the University of California, Berkeley, generally agreed with the report’s assertion that in the states studied, accountability systems appear to be having a sustained effect at raising student test scores.

But he pointed out that such gains generally haven’t been reflected on other measures, such as the National Assessment of Educational Progress.

The CEP analysis does not separate scores by grade levels, so it’s unclear whether the accountability systems are raising basic numeracy and literacy skills or more complex skills at higher grades, he added.

“If they’re just squishing grade levels together, we can’t get at that question,” said Mr. Fuller, who has studied test-score plateaus in California.

The higher scores may not reflect greater student learning, he said.

“Perhaps trend lines climb mainly in states that rarely change their testing regimes. The exams simply become more familiar to teachers over time. The dilemma is that when states change tests, the results cannot be reliably tracked,” Mr. Fuller said.

The report does not attempt to limn why the test-score patterns appear to vary from state to state, and Mr. Jennings sounded a note of caution on that subject.

“It should make us all a little more cautious about believing all test results are sacrosanct,” he said. “You do get different patterns, and it could be because of different types of tests, an influx of immigrant kids into an area, or how teachers are teaching.”

A version of this article appeared in the August 12, 2009 edition of Education Week

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Reading & Literacy Webinar
The Future of the Science of Reading
Join us for a discussion on the future of the Science of Reading and how to support every student’s path to literacy.
Content provided by HMH
Mathematics K-12 Essentials Forum Helping Students Succeed in Math
Student Well-Being Live Online Discussion A Seat at the Table: The Power of Emotion Regulation to Drive K-12 Academic Performance and Wellbeing
Wish you could handle emotions better? Learn practical strategies with researcher Marc Brackett and host Peter DeWitt.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Opinion A D.C. Insider Explains What’s Changed in Education Policy
The biggest thing that people don’t understand about federal education policy? How much the details really matter.
7 min read
The United States Capitol building as a bookcase filled with red, white, and blue policy books in a Washington DC landscape.
Luca D'Urbino for Education Week
Federal What Superintendents Think About a Steady Clip of Federal K-12 Changes
A state superintendent and two district leaders shared their thoughts on the latest changes coming from Washington.
4 min read
From left, Quentin J. Lee, superintendent of Talladega City Schools, Keith Konyk, superintendent of Elizabeth Forward School District, and Eric Mackey, Alabama's state superintendent of education, discuss the latest K-12 policy changes at the ISTELive 25 + ASCD Annual Conference 25 on July 2, 2025.
From left, Quentin J. Lee, superintendent of Talladega City Schools in Alabama; Keith Konyk, superintendent of Elizabeth Forward School District in Pennsylvania; and Eric Mackey, Alabama's state superintendent of education, discuss the latest K-12 policy changes at the ISTELive 25 + ASCD Annual Conference 25 on July 2, 2025.
Kaylee Domzalski/Education Week
Federal The Senate Passed a Federal Voucher Program. What's in It?
The measure would create a national program funding private school tuition through tax credits, though states would have to opt in.
7 min read
The Senate side of the Capitol is seen in Washington, early Monday, June 30, 2025, as Republicans plan to begin a final push to advance President Donald Trump's big tax breaks and spending cuts package.
The Senate side of the Capitol is seen in Washington early on June 30, 2025, hours before Republicans narrowly passed President Donald Trump's big tax breaks and spending cuts package. The bill includes the first major federal private school choice program.
J. Scott Applewhite/AP
Federal Senate Narrowly Passes Trump’s Big Tax Breaks and Spending Cuts Bill
The bill goes back to the House, where Speaker Mike Johnson warned off big revisions from his chamber’s version.
5 min read
Senate Majority Leader John Thune, R-S.D., center, joined from left by, Sen. John Barrasso, R-Wyo., the GOP whip, Finance Committee Chairman Mike Crapo, R-Idaho, and Budget Committee Chairman Lindsey Graham, R-S.C., speaks to reporters after passage of the budget reconciliation package of President Donald Trump's signature bill of big tax breaks and spending cuts, at the U.S. Capitol in Washington, D.C., on July 1, 2025.
Senate Majority Leader John Thune, R-S.D., center, joined from left by Sen. John Barrasso, R-Wyo., the GOP whip; Finance Committee Chairman Mike Crapo, R-Idaho; and Budget Committee Chairman Lindsey Graham, R-S.C., speaks to reporters after passage of the budget reconciliation package of President Donald Trump's signature bill of big tax breaks and spending cuts, at the U.S. Capitol on July 1, 2025. The bill includes the first major federal investment in a private school choice program.
J. Scott Applewhite/AP