Federal

Union-Funded Study Finds Fault With High-Stakes Testing

By Kathleen Kennedy Manzo — September 27, 2005 4 min read

New research contending that current accountability pressures have yielded no real achievement gains touched off another round of skirmishing last week over the reliability of a series of union-financed studies criticizing high-stakes testing.

Titled “High-Stakes Testing and Student Achievement: Problems for the No Child Left Behind Act,” the new report concludes that students in states with test-based accountability systems have not shown improvement on national assessments.

The reports, “High-Stakes Testing and Student Achievement: Problems for the No Child Left Behind Act,” and “The Impact of the Adequate Yearly Progress Requirement of the Federal “No Child Left Behind” Act on Schools in the Great Lakes Region” are posted by the Education Policy Studies Laboratory.

Those states also tend to have higher dropout rates and larger numbers of students retained in key grades, problems that disproportionately affect minority students, the study concludes.

“The theory is that if we were to exert more pressure on the key players in a state, … they will live up to that pressure by working harder, and that ultimately that will be translated into more learning,” said researcher Sharon L. Nichols, who wrote the report with Gene V. Glass and David C. Berliner. “But there is no systematic relationship with that pressure that affects student learning or learning gains.”

Released Sept. 20 by the Education Policy Studies Laboratory at Arizona State University, the report is the latest in a series of similar studies funded by a center associated with the National Education Association and its affiliates that has drawn sharp criticism from education researchers who deem it “advocacy research” of questionable scholarly value.

The new study’s methodology, those critics maintain, is flawed and designed around the biases of the authors and funders. Some scholars have examined the data and concluded the opposite of the study’s findings: that strong state accountability systems can help improve student achievement.

The study was underwritten by the Great Lakes Center for Education Research and Practice, an East Lansing, Mich.-based group founded by the Michigan Education Association, an NEA affiliate. The center says its mission is to support and disseminate “empirically sound research on education policy and practice.”

The 2.7 million-member NEA filed a lawsuit against the U.S. Department of Education in April, alleging that states are illegally being required to use their own money to carry out the mandates of the federal No Child Left Behind law.

Pressure Gauge

Mr. Berliner, a professor of education at Arizona State, in Tempe, released a similar study in 2003 with Audrey L. Amrein, also of Arizona State, that looked at scores on the National Assessment of Educational Progress in 28 states, as well as results on Advanced Placement and college-admissions exams.

That study was criticized for comparing gains in states with strong accountability programs with national averages on NAEP. A 2003 analysis by two Stanford University professors found that if the NAEP mathematics scores in those states were compared instead with those in states without strong accountability measures, the results were reversed. (“Study Finds Higher Gains in States With High-Stakes Tests,” April 16, 2003.)

In the latest study, Mr. Berliner and his colleagues analyzed policies in 25 states that have long had test-based accountability systems.

They developed what they call a “pressure rating index”—taking into account policies in such areas as student promotion, bonuses for teachers, and transfer options for students in failing schools—to gauge how much pressure those states placed on schools and teachers to improve test results. They then compared progress on the NAEP scores for those states with the national average between 1990 and 2005.

Eric A. Hanushek, a senior fellow at the Hoover Institution at Stanford University, contended last week that the index itself is invalid.

“They’ve spent years trying to attack testing and accountability,” said Mr. Hanushek, who with a colleague, Margaret E. Raymond, conducted the 2003 analysis of the research by Mr. Berliner and Ms. Amrein and came up with a different result. “I can’t quite take it very seriously. They make up their own index, and surprisingly their index gives them all the answers they want.”

Mr. Berliner dismissed Mr. Hanushek’s criticism. “We think our data are as strong as can be,” he said.

Teri L. Moblo, the director of the Great Lakes Center, said the study was “good, clean research, the most high-quality research we can fund.”

She added that the center commissions studies on research topics of interest to the center, but publishes it regardless of the results.

“Our goal is to get it out there and create the conversation,” she said.

A version of this article appeared in the September 28, 2005 edition of Education Week as Union-Funded Study Finds Fault With High-Stakes Testing

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Measuring & Supporting Student Well-Being: A Researcher and District Leader Roundtable
Students’ social-emotional well-being matters. The positive and negative emotions students feel are essential characteristics of their psychology, indicators of their well-being, and mediators of their success in school and life. Supportive relationships with peers, school
Content provided by Panorama Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
Making Digital Literacy a Priority: An Administrator’s Perspective
Join us as we delve into the efforts of our panelists and their initiatives to make digital skills a “must have” for their district. We’ll discuss with district leadership how they have kept digital literacy
Content provided by Learning.com
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School & District Management Webinar
How Schools Can Implement Safe In-Person Learning
In order for in-person schooling to resume, it will be necessary to instill a sense of confidence that it is safe to return. BD is hosting a virtual panel discussing the benefits of asymptomatic screening
Content provided by BD

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Miguel Cardona: Schools Must Work to Win Trust of Families of Color as They Reopen
As Secretary of Education Miguel Cardona announced new school reopening resources, he encouraged a focus on equity and student engagement.
4 min read
Education Secretary nominee Miguel Cardona testifies before the Senate Health, Education, Labor and Pensions committee during his confirmation hearing Feb. 3, 2021.
Now-U.S. Secretary of Education Miguel Cardona testifies before the Senate Health, Education, Labor and Pensions committee during his confirmation hearing in February.
Susan Walsh/AP
Federal CDC: Nearly 80 Percent of K-12, Child-Care Workers Have Had at Least One COVID-19 Shot
About four out of five teachers, school staffers, and child-care workers had first COVID-19 vaccine doses by the end of March, CDC says.
2 min read
John Battle High School teacher Jennifer Daniel receives her COVID-19 vaccine on Jan. 11, 2021. Teachers received their first vaccine during an all-day event at the Virginia Highlands Higher Education Center in Abingdon, Va.
John Battle High School teacher Jennifer Daniel receives her COVID-19 vaccine on Jan. 11at the Virginia Highlands Higher Education Center in Abingdon, Va.
David Crigger/Bristol Herald Courier via AP
Federal Ed. Dept. to Review Title IX Rules on Sexual Assault, Gender Equity, LGBTQ Rights
The review could reopen a Trump-era debate on sexual assault in schools, and it could spark legal discord over transgender student rights.
4 min read
Symbols of gender.
iStock/Getty
Federal Q&A EdWeek Q&A: Miguel Cardona Talks Summer Learning, Mental Health, and State Tests
In an interview after a school reopening summit, the education secretary also addressed teachers' union concerns about CDC guidance.
10 min read
Education Secretary Miguel Cardona speaks during a press briefing at the White House on March 17, 2021.
U.S. Secretary of Education Miguel Cardona speaks during a press briefing at the White House on March 17.
Andrew Harnik/AP