Standards

Teaching to the Test?

By Ulrich Boser — June 07, 2000 6 min read
  • Save to favorites
  • Print

When Sherrie L. Matula took all of her test-preparation materials for the Texas student assessment and stacked them atop one another, they stood about as tall as she is—close to 6 feet.

That pile of materials illustrates the high-stakes testing fire licking at teachers’ feet at Maesmythe Elementary School in Pasadena, Texas, where Ms. Matula teaches 4th grade. Besides the state’s heavy emphasis on exam-driven accountability, her district bases teachers’ salaries in part on student test scores. Those policies have forced teachers to teach to a basic-skills test, Ms. Matula says, echoing an increasingly common complaint of educators in many states.

But a forthcoming study by researchers from the University of Wisconsin suggests there may be little overlap between what state assessments test and what teachers teach. In one of the 10 states studied, the overlap in one subject was found to be just 5 percent.

The findings raise questions about the implementation of a basic premise of standards-based accountability: States should delineate what students should know and be able to do, teachers should match instruction to those standards, and state tests should measure how well students meet those expectations.

“It’s a very sloppy system right now,” said John F. Jennings, the director of the Center on Education Policy, a Washington research group. “Teachers are teaching what they think is best, and that might not be aligned” with the state standards or assessments.

The researchers at the Wisconsin Center for Education Research, based at the University of Wisconsin-Madison, surveyed mathematics and science teachers and examined state-administered exams in those subjects for grades 4 and 8. The detailed survey instrument asked teachers about the content they teach and the classroom practices and modes of thinking that their instruction requires.

Because they were not chosen at random, the 600 teachers surveyed are not statistically representative of teachers in those states, but the data do offer some insight into the effects of standards-based accountability. State education departments helped the researchers line up volunteers for the survey.

Few Performance Items

Instruction across the 10 states studied was similar, according to the researchers. But the content that the state exams assessed varied greatly.

The tests, the researchers found, mainly asked students to recall facts and perform other simple procedures, while classroom instruction focused more on solving novel problems or applying skills.

The highest level of overlap between teaching and the test was 46 percent—in 4th grade science in a single state. The lowest level, 5 percent, between a state test and instruction was in 8th grade math.

States don’t test students on higher-end expectations because it is too expensive, said Andrew C. Porter, the principal researcher and the director of the center.

For instance, the study found that one-fourth of science-class time was spent on hands-on science or laboratory activities. Yet such performance items were rarely included on state tests.

The Council of Chief State School Officers helped the researchers gather their data, and the National Science Foundation subsidized the project, “Using Data on Enacted Curriculum in Mathematics and Science.”

The report, which was previewed at this year’s American Educational Research Association conference in April, will be released this summer.

The participating states were Kentucky, Louisiana, Massachusetts, Minnesota, Missouri, North Carolina, Ohio, Pennsylvania, South Carolina, and West Virginia. State-specific results will not be released.

‘Doing More’

Sharon M. Stenglein, a math specialist in the Minnesota education department, agreed with the study’s conclusion that the type of test makes a big difference in the quantity and quality of alignment.

“Our minimum-competency test had a narrow range of content and cognitive demand. ... Teachers [in our state] are doing more,” she said. “That would show a low alignment, and that’s fine.”

Mr. Porter said that not all states considered a low level of alignment acceptable. When he presented his findings to them, many said they would revise their exams to better reflect teacher practice, he said. Each state, he noted, has to find the level of alignment that best suits its needs.

The lack of cohesion between instruction and tests was not a surprise to some observers.

“This is a snapshot of one stage [of standards-based changes], and it’s a pretty early stage,” Mr. Jennings said. “I’m not surprised that teachers are not teaching to the test.”

Other experts raised methodological concerns, in addition to the nonrandom selection of the teachers surveyed.

“The complexity of the teaching process is hard to summarize using something as simplistic as a survey,” said Daniel P. Mayer, a researcher at Mathematica Policy Research Inc., based in Washington. Mr. Mayer, who had not read the study, has investigated the differences between what teachers say in surveys and what they do in the classroom. He has found that teachers often think of themselves as practicing a certain innovative method, when in fact their instruction is not much different from traditional approaches.

Regardless of the reasons for the high degree of misalignment between teaching and testing the Wisconsin researchers found, some critics have attacked states for not doing enough to explain to teachers what is on state tests—an omission seen as especially troubling given the penalties and rewards states increasingly have attached to their exams.

“States are afraid to dictate [specific standards], but then issue the darn tests,” Mr. Jennings said. “Then, they go to the press saying schools are failing and teachers are not doing their job. ... That’s not fair.

“Teachers should be told [by the state] that this is the instruction that we expect if you want your students to do well on these tests.”

John F. Jennings

John L. Smithson, a project director at the Wisconsin center, said that for the most part, states have used high-stakes tests rather than state academic standards to guide instruction.

“The tests are attractive [to states] because they get people’s attention, and they provide a tool to measure outcomes,” he said. “It’s an attractive policy but limited.”

The research group has not yet examined state standards using the same methods it employed to look at instruction and assessments. That is the next step in the project.

Teaching to the Content

Some educators say they do not feel much state pressure to teach to the test.

Ethel C. Williams, an 8th grade language arts teacher at the 71st Classical Middle School in Fayetteville, N.C., said that her instruction is “student-focused and [state standards] focused.”

“I would not like to know what is on the test. Then I would teach to the test and not to the students,” she added.

Ms. Williams acknowledged that she does teach students some test-taking strategies, including such practices as perusing a question before reading the accompanying reading passage. That helps students focus on what is being asked in a particular test question, she said.

W. James Popham, an assessment expert and a professor emeritus at the University of California, Los Angeles noted that such test-preparation practices can enter into a gray area between teaching to actual test items and teaching to the content represented by the test.

“Familiarity with the form of the test, that’s good,” he said, “but we find, in some schools, that they are shutting down everything for a month or more” to prepare for the test.

Related Tags:

A version of this article appeared in the June 07, 2000 edition of Education Week as Teaching to the Test?

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards Florida's New African American History Standards: What's Behind the Backlash
The state's new standards drew national criticism and leave teachers with questions.
9 min read
Florida Governor and Republican presidential candidate Ron DeSantis speaks during a press conference at the Celebrate Freedom Foundation Hangar in West Columbia, S.C. July 18, 2023. For DeSantis, Tuesday was supposed to mark a major moment to help reset his stagnant Republican presidential campaign. But yet again, the moment was overshadowed by Donald Trump. The former president was the overwhelming focus for much of the day as DeSantis spoke out at a press conference and sat for a highly anticipated interview designed to reassure anxious donors and primary voters that he's still well-positioned to defeat Trump.
Florida Governor and Republican presidential candidate Ron DeSantis speaks during a press conference in West Columbia, S.C., on July 18, 2023. Florida officials approved new African American history standards that drew national backlash, and which DeSantis defended.
Sean Rayford/AP
Standards Here’s What’s in Florida’s New African American History Standards
Standards were expanded in the younger grades, but critics question the framing of many of the new standards.
1 min read
Vice President Kamala Harris speaks at the historic Ritz Theatre in downtown Jacksonville, Fla., on July 21, 2023. Harris spoke out against the new standards adopted by the Florida State Board of Education in the teaching of Black history.
Vice President Kamala Harris speaks at the historic Ritz Theatre in downtown Jacksonville, Fla., on July 21, 2023. Harris spoke out against the new standards adopted by the Florida state board of education in the teaching of Black history.
Fran Ruchalski/The Florida Times-Union via AP
Standards Opinion How One State Found Common Ground to Produce New History Standards
A veteran board member discusses how the state school board pushed past partisanship to offer a richer, more inclusive history for students.
10 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards The Architects of the Standards Movement Say They Missed a Big Piece
Decisions about materials and methods can lead to big variances in the quality of instruction that children receive.
4 min read
Image of stairs on a blueprint, with a red flag at the top of the stairs.
Feodora Chiosea/iStock/Getty