Federal

Purpose of Testing Needs to Shift, Experts Say

By Lynn Olson — October 18, 2005 4 min read
  • Save to favorites
  • Print

“We’ve got to stop using assessments as a hammer and begin to use them appropriately, as a diagnostic and learning tool,” Kurt Landgraf, the president of the Educational Testing Service, said at the organization’s 2005 Invitational Conference here last week.

BRIC ARCHIVE

The two-day event, Oct. 10-11, focused on ways to embed assessments directly into teaching and learning to help teachers adjust instruction as it’s occurring. In the United States, participants argued, far more attention has been paid to using tests as an accountability tool, and to sort and classify students, than to shape what actually happens in the classroom.

While teachers give tests or quizzes and assign papers all the time, they said, the quality of those tools is often lacking. What’s more, the purpose typically is to grade students rather than to modify instruction or provide students with detailed feedback.

Approaches suggested here for improving classroom assessments ranged from sharpening teachers’ questioning techniques to computer-based systems that allow continual tailoring of instruction to students’ responses.

“If assessment is going to be particularly powerful in achieving enhanced learning outcomes, then it’s at the classroom level that we need to focus our attention,” said James W. Pellegrino, a professor of cognitive psychology and education at the University of Illinois at Chicago. “As instruction is occurring, teachers need information to evaluate whether their teaching strategies are working.”

Curriculum Tests

In particular, he pointed to a need for better “formative assessments” that are given regularly in the classroom and provide quick information that lets teachers and students adjust what’s happening to promote learning. “The catch here is that it isn’t easy to do this well,” Mr. Pellegrino said. “It doesn’t happen anywhere near the level we would like.”

Mr. Pellegrino said little is known about the quality of assessments now included with commercial curriculum products. Working with the 427,000-student Chicago school system, he is examining the tests included in four popular math programs:Everyday Mathematics, Math Trailblazers, the Connected Mathematics Project, and Math Thematics.

BRIC ARCHIVE

The good news, he said, is that the curriculum assessments reflect both state and district-level academic-content standards and those from the National Council of Teachers of Mathematics.

They also include assessment resources that go well beyond testing students’ factual knowledge, he added. Examples include journal prompts, open- response problems, laboratory investigations, and long-term projects that require students to reason mathematically, apply their knowledge, use multiple solution approaches, and communicate about math either orally or in writing.

But it’s typically not made clear to teachers which standards are being assessed, the level of cognitive knowledge that’s being tapped, the range of expected student performance, or how to adjust instruction based on students’ responses, Mr. Pellegrino said.

Interviews with teachers, he said, suggest they don’t fully grasp the assessment components built into the curricula or how to use them during instruction.

M. Susanna Navarro, the director of the El Paso Collaborative for Academic Excellence, in El Paso, Texas, said that teachers often have trouble figuring out how to assess students at the highest levels of cognitive demand, and that most teacher education programs provide too little preparation in how to integrate high-quality testing with instruction.

“Formative assessment is still not seen as integral to lesson planning,” she said.

Term Being Hijacked?

A focus on “assessment for learning” can yield “radical effects,” said Dylan Wiliam, the senior research director of the Learning and Teaching Research Center at the Princeton, N.J.-based ETS. “I think we’ve got a quite clear view of what it is we want teachers to be doing,” he said. “The challenge is to get teachers doing this at scale.”

Charlotte Danielson, an independent consultant based in Princeton, said engaging teachers in the design and use of assessments, particularly through the close examination of student work, gives teachers strong feedback about their own instructional practices and about common student misconceptions.

“When this is done by teachers working together,” she said, “the entire intellectual capital of the school is enhanced.”

Lorrie A. Shepard, the dean of the school of education at the University of Colorado at Boulder, said she worries that the term “formative assessment” is being hijacked by commercial test publishers, which are marketing exams that could take time and resources away from instruction.

“If you thought the high-stakes test given once per year was distorting the curriculum,” she said, “wait till you give lots of examples all year long.”

Ms. Shepard urged commercial publishers and states to focus on devising rich curriculum units with accompanying assessments that could provide models of good instructional and assessment practices for teachers.

Other participants at the New York City conference focused on computerized “intelligent tutoring systems,” which can adjust computer-led instruction as it’s occurring, based on students’ responses to complex, multiple-step problems.

Edmund W. Gordon, a professor emeritus of psychology at Yale University, indicated that he foresaw a move away from using assessments chiefly as a tool for sorting, classifying, and rating schools and students. “I predict that educational assessments in the future will be more and more concerned with the improvement of teaching and learning as its principal purpose,” he said.

A version of this article appeared in the October 19, 2005 edition of Education Week as Purpose of Testing Needs to Shift, Experts Say

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Biden Calls for Teacher Pay Raises, Expanded Pre-K in State of the Union
President Joe Biden highlighted a number of his education priorities in a high-stakes speech as he seeks a second term.
5 min read
President Joe Biden delivers the State of the Union address to a joint session of Congress at the Capitol on March 7, 2024, in Washington.
President Joe Biden delivers the State of the Union address to a joint session of Congress at the Capitol on March 7, 2024, in Washington.
Shawn Thew/Pool via AP
Federal Low-Performing Schools Are Left to Languish by Districts and States, Watchdog Finds
Fewer than half of district plans for improving struggling schools meet bare minimum requirements.
11 min read
A group of silhouettes looks across a grid with a public school on the other side.
Vanessa Solis/Education Week via Canva
Federal Biden Admin. Says New K-12 Agenda Tackles Absenteeism, Tutoring, Extended Learning
The White House unveiled a set of K-12 priorities at the start of an election year.
4 min read
U.S. Education Secretary Miguel Cardona participates in a roundtable discussion with students from Dartmouth College on Jan. 10, 2024, on the school's campus, in Hanover, N.H.
U.S. Education Secretary Miguel Cardona participates in a roundtable discussion with students from Dartmouth College on Jan. 10, 2024, on the school's campus, in Hanover, N.H.
Steven Senne/AP
Federal Lawmakers Want to Reauthorize a Major Education Research Law. What Stands in the Way?
Lawmakers have tried and failed to reauthorize the Education Sciences Reform Act over the past nearly two decades.
7 min read
Sen. Bill Cassidy, R-La., left, joins Senate Health, Education, Labor and Pensions Committee Chairman Bernie Sanders, I-Vt., left, as Starbucks founder Howard Schultz answers questions about the company's actions during an ongoing employee unionizing campaign, at the Capitol in Washington, on March 29, 2023.
Sen. Bill Cassidy, R-La., left, joins Senate Health, Education, Labor and Pensions Committee Chairman Bernie Sanders, I-Vt., left, at the Capitol in Washington, on March 29, 2023. The two lawmakers sponsored a bill to reauthorize the Education Sciences Reform Act.
J. Scott Applewhite/AP