Assessment

Survey Shows State Testing Alters Instructional Practices

By Lynn Olson — April 24, 2002 5 min read

Teachers are changing what and how they teach in response to state testing programs, preliminary results from a multistate survey have found. Those changes are greatest in states where more consequences are attached to test results, according to the two-year study by researchers at Boston College’s National Board on Educational Testing and Public Policy.

Joseph Pedulla, an associate professor of education at the college and a member of the study team, said the nationally representative survey of 12,000 teachers was “the broadest survey of teachers of this scope on this topic that has been done.”

Tentative results from the study were issued here this month at the annual meeting of the American Educational Research Association. The full report is scheduled to be released in September.

The sample was designed to reflect the views of teachers in states with low, moderate, and high stakes attached to their test results for students, and for teachers, schools, and districts. States with low stakes have no observable consequences attached to test scores, while those with high stakes may award diplomas to students and accreditation to schools based largely on test results. And those with moderate stakes might, for example, report test scores and school rankings in the media. Among the study’s initial findings:

A higher percent of teachers in high-stakes states reported that instruction in tested areas had increased. Forty-three percent of teachers in such states said that instruction in the tested areas had risen “a great deal,” compared with 17 percent in states with moderate stakes for schools and low stakes for students.· A higher percent of teachers in high- stakes states reported that instruction in tested areas had increased. Forty- three percent of teachers in such states said that instruction in the tested areas had risen “a great deal,” compared with 17 percent in states with moderate stakes for schools and low stakes for students.

•Teachers from high- stakes states also were more likely to say that instruction had decreased in areas not covered by the state test. One-fourth of teachers in states with high stakes for students and schools reported cutting back on instruction “a great deal” in untested areas, compared with 9 percent of teachers in states with moderate or low stakes.

•Teachers in high-stakes states also said more often that they used test-preparation strategies than teachers working in moderate- or low-stakes states did. Such strategies include teaching test-taking skills; teaching the standards or frameworks known to be on the test; and providing students with items similar to those on the test, test-specific preparation materials, and publicly released items from state-mandated tests.

The survey was conducted between February and March 2001. Approximately 4,200 teachers responded to it, for a response rate of 35 percent. The study was underwritten by the Atlantic Philanthropies, which also subsidizes Education Week‘s coverage of international education.

Mr. Pedulla said the results were weighted, “so we’re pretty confident that we have a reasonable sample to generalize to the national sample of teachers.”

While teachers from high-, moderate-, and low-stakes states were responding in similar ways to state testing programs, “it was the intensity that seems to vary,” said Lisa Abrams, a doctoral student and a researcher on the team.

No Stakes for Teachers

Teachers in high-stakes-testing environments were more likely than their colleagues in other states to say that it was appropriate to use test results to hold schools and students accountable.

For example, 34 percent of teachers in high-stakes states said it was “very” or “moderately” appropriate to use test results for school accreditation, compared with 22 percent of teachers in states with lower stakes. Fifty-seven percent of teachers in high-stakes states, compared with 37 percent of those in lower- stakes states, supported using test results for high school graduation.

But the vast majority of teachers did not approve of using test results to hold individual teachers accountable for their performance. Fifty-six percent of teachers in high-stakes states and 64 percent of teachers in states with lower stakes deemed such policies “very inappropriate.”

“We all have a human tendency to feel it’s OK for everybody else to be held accountable,” said Mr. Pedulla. “The personal accountability, I guess, is just more frightening. I don’t have any data to substantiate that.”

Although teachers in all states reported feeling pressure from their principals to raise test scores, teachers in high-stakes environments were far more likely to note feeling such pressure and to feel it more intensely.

“In the public debate, in the public conversation, the voices of those who are implementing testing and accountability policies are either underheard or not heard much at all,” said Arnold Shore, the executive director of the National Board on Educational Testing and Public Policy and a professor of education at Boston College.

“We believe that teacher opinions and the views of others who are involved in the school setting are key to reasonable testing and accountability policies—a point that has not yet entered the public conversation,” he argued.

Implementation Concerns

In addition to the large-scale survey, the researchers conducted more in-depth field studies in three states: Kansas, Massachusetts, and Michigan. Although all three rate schools based, in part, on test results, their consequences for individual students vary. Within each state, the researchers conducted interviews with administrators and teachers in four districts—one large urban, one small urban, one suburban, and one rural—and in up to six schools in each district: two elementary schools, two middle schools, and two high schools.

The researchers conducted more than 360 taped interviews and collected samples of classroom teaching and testing materials. The interviews are being coded to look for overall themes and patterns.

“What we would like the public to hear is what we’re beginning to hear,” Mr. Shore said. “Teachers are not against standards and frameworks. They welcome, or at least accept, accountability.” But they have a long list of concerns about how such accountability policies are being implemented, he said.

“In the main,” Mr. Shore said, “we are finding that teachers are optimistic and adaptive. They are trying to make things work.”

Coverage of research is underwritten in part by a grant from the Spencer Foundation.

Related Tags:

A version of this article appeared in the April 24, 2002 edition of Education Week as Survey Shows State Testing Alters Instructional Practices

Events

School & District Management Webinar What's Ahead for Hybrid Learning: Putting Best Practices in Motion
It’s safe to say hybrid learning—a mix of in-person and remote instruction that evolved quickly during the pandemic—is probably here to stay in K-12 education to some extent. That is the case even though increasing
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Building Equitable Systems: Moving Math From Gatekeeper to Opportunity Gateway
The importance of disrupting traditional American math practices and adopting high-quality math curriculum continues to be essential for changing the trajectory of historically under-resourced schools. Building systems around high-quality math curriculum also is necessary to
Content provided by Partnership for L.A. Schools
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Measuring & Supporting Student Well-Being: A Researcher and District Leader Roundtable
Students’ social-emotional well-being matters. The positive and negative emotions students feel are essential characteristics of their psychology, indicators of their well-being, and mediators of their success in school and life. Supportive relationships with peers, school
Content provided by Panorama Education

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Assessment Opinion AP Exams Can't Be Business as Usual This Year
The College Board seems unconcerned with the collateral damage of its pandemic approach, writes an assistant superintendent of curriculum and instruction.
Pete Bavis
5 min read
Illustration of large boat in turbulent waters with other smaller boats falling into the abyss.
iStock/Getty Images Plus
Assessment Federal Lawmakers Urge Miguel Cardona to Let States Cancel Tests, Highlighting Discord
A letter from Democratic members to the new education secretary calls for an end to the "flawed" system of annual standardized exams.
3 min read
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
Jamaal Bowman speaks to reporters after voting at a polling station inside Yonkers Middle/High School in Yonkers, N.Y. on June 23, 2020.
John Minchillo/AP
Assessment How Two Years of Pandemic Disruption Could Shake Up the Debate Over Standardized Testing
Moves to opt out of state tests and change how they're given threaten to reignite fights over high-stakes assessments.
9 min read
Image of a student at a desk.
patat/iStock/Getty
Assessment A Plan for Standardized Test Scores During the Pandemic Has Gotten States' Attention
A testing expert says his idea would provide helpful data with key context, but said other measures about student well-being are crucial.
7 min read
HS class 1257213326
Getty