School & District Management

Second Look at Tougher Accountability Yields New Results

By Debra Viadero — May 10, 2005 4 min read

Two years ago, a pair of Stanford University researchers published a study suggesting that students’ math scores were rising faster in states that had put stronger pressure on schools and students to raise academic achievement than existed in states with weaker school accountability programs.

But last week, the researchers presented new findings suggesting that, over the long run, the achievement picture for those states may be a bit more complicated.

For their new study, researchers Martin Carnoy and Susanna Loeb tracked students in all 50 states over a longer period of time and added data from federal tests in reading as well as math. In most of the states with high-pressure testing systems in place, they found, the mathematics improvements that the researchers had documented in the late 1990s tapered off from 2000 to 2003. And in students’ reading scores, it seemed to make no difference whether a state had attached high stakes to the test scores or not.

The study, one of eight presented at a national conference here last week, hints at some of the surprises—and the potential for new knowledge—emerging now as researchers and states put in place new data systems that allow them to track the progress of schools and students on a large scale, and over a longer period of time.

“A lot of these data are becoming available because of new accountability systems,” said Jane Hannaway, the director of the Center on Education Policy at the Urban Institute.

The Washington-based think tank organized the May 2 conference specifically to highlight findings from those new longitudinal research efforts. “Over the next five to ten years,” she added, “I think we will learn some things that we may not have expected. We do know for certain that we will learn a lot.”

The Stanford researchers cautioned that their findings are still preliminary. They based them on 4th and 8th grade results from National Assessment of Educational Progress tests in reading and math, which were given every two to three years between 1992 and 2003.

No Easy Answers

Mr. Carnoy, the report’s lead author, said he had no easy explanation for the change in the pattern of results that he and Ms. Loeb found. One possibility, he said, may be that the test scores in those high-pressure states simply slowed.

“Or,” he added, “so many other states came on board with stronger accountability mechanisms that we don’t get as much variation among the states.”

For instance, with the adoption of the federal No Child Left Behind Act, which President Bush signed into law in January 2002, states were required to put in place student-testing systems and to report publicly on the results in order to continue to receive funding under the Title I program for disadvantaged students.

The researchers did find that the academic gains in the high-pressure states were significant for black and Latino students. They kept pace with white students during the first part of the study, from 1996 to 2000, and then increased at a faster clip from 2000 to 2003. Though scores improved for students at both ends of the achievement spectrum, the gains were largest over the long run for minority students in the area of basic skills.

But because white students’ scores also improved, the black-white achievement gap decreased only slightly, added Mr. Carnoy, who is a professor of education and economics at Stanford.

David N. Figlio, an economist at the University of Florida in Gainesville, who commented on the study at the Washington conference, said there also may be other explanations for the dropoff in overall test-score gains.

“Maybe the states with the most to gain from school accountability efforts implemented them first,” he suggested.

Reading Approaches

Another paper presented at last week’s conference previewed results from a study tracking instructional improvements in reading in 107 schools in 17 states.

As part of that study, which was led by researchers from the University of Michigan in Ann Arbor, 1st grade teachers were paid to keep logs detailing their teaching activities. Based on the logs, the researchers categorized classroom reading instruction into four types, which ranged from classes in which teachers emphasized showing students how to decode and analyze words to those that focused heavily on teaching reading comprehension, as well as broader mixes of both those approaches.

“We focused on the comprehension-focused programs,” said lead author Brian Rowan. “We wanted to know: Can it achieve positive effects without sacrificing growth in word-analysis skills?”

It did. Students who started out the school year achieving at the 50th percentile on standardized reading-comprehension tests ended the year scoring, on average, at the 62nd percentile. On word-analysis tests, students moved from the 50th to the 57th percentile, according to Mr. Rowan, an education professor at Michigan.

Ms. Hannaway said the Urban Institute plans to pull together all the papers presented at the conference in a forthcoming book.

Related Tags:


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Culturally Relevant Pedagogy to Advance Educational Equity
Schools are welcoming students back into buildings for full-time in-person instruction in a few short weeks and now is the perfect time to take a hard look at both our practices and systems to build
Content provided by PowerMyLearning
Classroom Technology Webinar Making Big Technology Decisions: Advice for District Leaders, Principals, and Teachers
Educators at all levels make decisions that can have a huge impact on students. That’s especially true when it comes to the use of technology, which was activated like never before to help students learn
Professional Development Webinar Expand Digital Learning by Expanding Teacher Training
This discussion will examine how things have changed and offer guidance on smart, cost-effective ways to expand digital learning efforts and train teachers to maximize the use of new technologies for learning.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Opinion Leaders, Your Communication Plan Needs to Start With Your Staff
Staff members are the point of contact for thousands of interactions with the public each day. They can’t be the last to know of changes.
Gladys I. Cruz
2 min read
A staff meeting around a table.
Vanessa Solis/Education Week and Getty Images
School & District Management L.A. Unified to Require Testing of Students, Staff Regardless of Vaccination Status
The policy change in the nation's second-largest school district comes amid rising coronavirus cases, largely blamed on the Delta variant.
Howard Blume, Los Angeles Times
4 min read
L.A. schools interim Sup Megan K. Reilly visits Fairfax High School's "Field Day" event to launch the Ready Set volunteer recruitment campaign to highlight the nationwide need for mentors and tutors, to prepare the country's public education students for the upcoming school year. The event coincides with National Summer Learning Week, where U.S. Secretary of Education Miguel Cardona is highlighting the importance of re-engaging students and building excitement around returning to in-person learning this fall. high school, with interim LAUSD superintendent and others. Fairfax High School on Wednesday, July 14, 2021 in Los Angeles, CA.
In this July 14, 2021, photo, Los Angeles Unified School District interim Superintendent Megan K. Reilly speaks at an event at Fairfax High School in Los Angeles. Reilly announced a new district policy Thursday requiring all students and employees of the Los Angeles school district to take weekly coronavirus tests regardless of their vaccination status.
Al Seib/Los Angeles Times via TNS
School & District Management Why School Boards Are Now Hot Spots for Nasty Politics
Nationalized politics, shifts in local news coverage, and the rise of social media are turning school board meetings into slug fests.
11 min read
Collage of people yelling, praying, and masked in a board room.
Collage by Gina Tomko/Education Week and Getty Images
School & District Management Opinion The Six Leadership Lessons I Learned From the Pandemic
These guiding principles can help leaders prepare for another challenging year—and any future crises to come.
David Vroonland
3 min read
A hand about to touch a phone.
Vanessa Solis/Education Week and Getty Images