School & District Management

Study Finds Higher Gains in States With High-Stakes Tests

By Debra Viadero — April 16, 2003 3 min read

A forthcoming study by a pair of Stanford University researchers is further stoking the debate over whether states’ high-stakes testing programs can positively affect academic achievement.

Read “High Stakes Research,” from Education Next. (Requires Adobe’s Acrobat Reader.)

Debates over the value of accountability efforts that determine whether students graduate, which teachers win bonuses, and whether schools are taken over by states grew earlier this year after two Arizona State University researchers published a report arguing that such programs may do more harm than good. (“Researchers Debate Impact of Tests,” Feb. 5, 2003.)

The widely publicized report, coming at a time when the federal “No Child Left Behind” Act of 2001 has effectively made such programs the law of the land, drew a spate of critiques and counter- studies for its contentions that high-stakes efforts had failed to improve achievement and were pushing some students off the high school track.

In their new report, scheduled to be published next month in the magazine Education Next, researchers Margaret E. Raymond and Eric A. Hanushek add some strong wording to that chorus of criticism and also offer some new data of their own.

Different Conditions?

The two researchers contend that the biggest problem with the Arizona study is that the authors, drawing on scores for National Assessment of Educational Progress tests, compare the improvements made by students in states with strong accountability programs with the average national test-score gains made over the same time periods.

The better comparison to draw, they argue, would have been with states that have no accountability programs.

“The number-one precept of good analysis is that you examine the condition and then make an observation without the condition to see if it makes a difference,” said Ms. Raymond, who is the director of CREDO, formerly known as the Center for Research in Education Outcomes. The policy-research group is based at Stanford’s Hoover Institution.

When the data are analyzed that way, the Stanford researchers say, the results are reversed: From both 1996 to 2000 and 1992 to 2000, the average gain made by 4th and 8th graders in mathematics was higher in high-accountability states than it was for states that had not yet not attached any consequences for flat or falling test scores.

That trend held up, according to the authors, even when the data were adjusted to account for any changes in the percentages of students who were being excluded from the tests after the new accountability programs were put in place.

For their own analysis of NAEP mathematics data, the authors focused on states that imposed consequences on schools, rather than on students, for failing to raise test scores. They compared those states’ progress against that for states with no such programs.

The pair of researchers examined what happened to students’ growth in achievement as they moved from the 4th to the 8th grade in those states. While the tests were not given to exactly the same students, the authors say, the tests draw from students who were at least in the same age cohort. The researchers also made adjustments in the data to account for changes in state spending on education and in parents’ educational levels during the time frame they studied.

They found that the average percent test- score gain made by a typical student moving from 4th grade in 1996 to 8th grade in 2000—at 1.6 percent—was more than twice as high for states with consequential accountability programs as it was for those without them.

Audrey L. Amrein, one of the researchers who conducted the Arizona State study, called the Raymond-Hanushek criticisms “old hat.”

“I’ve had a lot of people reanalyze our data,” she added, “and each and every one of them have come up with different results. In no way is this analysis the last word.”

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Building Leadership Excellence Through Instructional Coaching
Join this webinar for a discussion on instructional coaching and ways you can link your implement or build on your program.
Content provided by Whetstone Education/SchoolMint
Teaching Webinar Tips for Better Hybrid Learning: Ask the Experts What Works
Register and ask your questions about hybrid learning to our expert panel.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement for Student Success With Dr. Karen Mapp
Register for this free webinar to learn how to empower and engage families for student success featuring Karen L. Mapp.
Content provided by Panorama Education & PowerMyLearning

EdWeek Top School Jobs

DevOps Engineer
Portland, OR, US
Northwest Evaluation Association
User Experience Analyst
Portland, OR, US
Northwest Evaluation Association
Senior Business Analyst - 12 Month Contract
Portland, OR, US
Northwest Evaluation Association
Senior Director Marketing
Philadelphia, Pennsylvania, United States
Camelot Education

Read Next

School & District Management The Key to School-Based COVID-19 Testing: Cooperation of Parents and Communities
As schools launch broad testing to track cases of COVID-19, the success of their efforts relies on addressing the concerns of all concerned.
7 min read
Katie Ramirez, left, watches as her mother, Claudia Campos, swabs the mouth of her sister, Hailey, for a COVID-19 test at a testing site in Los Angeles on Dec. 9, 2020.
Katie Ramirez, left, watches as her mother, Claudia Campos, swabs the mouth of her sister, Hailey, for a COVID-19 test at a testing site in Los Angeles.
Jae C. Hong/AP
School & District Management Interactive A Year of COVID-19: What It Looked Like for Schools
This timeline offers a look at how a full year of living and learning during the COVID-19 pandemic unfolded.
Education Week Staff
13 min read
Elementary 1 teacher Melissa Vozar sits outside of Suder Elementary in Chicago to teach a virtual class on Jan. 11, 2021. The Chicago Teachers Union said that its members voted to defy an order to return to the classroom before they are vaccinated against the coronavirus, setting up a showdown with district officials who have said such a move would amount to an illegal strike.
Elementary 1 teacher Melissa Vozar sits outside of Suder Elementary in Chicago to teach a virtual class on Jan. 11, 2021. The Chicago Teachers Union said that its members voted to defy an order to return to the classroom before they are vaccinated against the coronavirus, setting up a showdown with district officials who have said such a move would amount to an illegal strike.
Anthony Vazquez/Chicago Sun-Times via AP
School & District Management Most Principals, District Leaders Predict Their Schools Will Be Fully In-Person This Fall
EdWeek Research Center surveys track the growing trend to get more students back in school buildings as soon as possible.
5 min read
Assistant Principal Janette Van Gelderen, left, welcomes students at Newhall Elementary in Santa Clarita, Calif on Feb. 25, 2021. California's public schools could get $6.6 billion from the state Legislature if they return to in-person instruction by the end of March, according to a new agreement announced Monday, March 1, 2021, between Gov. Gavin Newsom and the state's legislative leaders.
Assistant Principal Janette Van Gelderen, left, welcomes students at Newhall Elementary in Santa Clarita, Calif., last month. California's public schools could get $6.6 billion from the state if they return to in-person instruction by the end of March.
Marcio Jose Sanchez/AP
School & District Management Opinion Will the Hybrid School Concept Continue After COVID-19?
In an effort to move from triage to transformation, schools should look at how they continue the hybrid model after the COVID-19 vaccine.
7 min read
Hybrid FCG
Shutterstock