Special Report
Federal

Funding for Common Assessments Poses Challenge

By Stephen Sawchuk — November 13, 2009 4 min read
  • Save to favorites
  • Print

Near the end of a public meeting held here last week, the director of the Race to the Top Fund competition at the U.S. Department of Education, Joanne Weiss, asked a group of assessment experts to summarize their thoughts about how the federal agency could work to improve the country’s assessment systems.

“Good luck,” deadpanned Lauress Wise, a scientist for the Alexandria, Va.-based Human Resources Research Organization, a nonprofit evaluation group.

The remark drew laughter from the researchers, federal officials, state assessment directors, and test vendors in attendance. But it also underscored the challenges the department faces in spending $350 million in economic-stimulus money to aid consortia of states in developing common assessments in reading and mathematics.

Three common messages emerged from the testing experts convened for the first of three meetings being held to advise the federal officials on how to design the competition for those funds:

• State consortia should consider devising assessments to aid instructional practices, in addition to the annual accountability tests now required by the federal No Child Left Behind Act.

• Teachers must be much more involved in the development, use, and possibly even the scoring of assessments.

• The Education Department should seek to structure state consortia in such a way that the one-time infusion of cash leverages sustained work.

In an interview, Ms. Weiss said that the early feedback had already started to shape possible approaches to the competition.

“I think there’s actually a path through,” she said.

Process Begins

The meeting was part of a series intended to help officials gain input into the design of the competition, one part of the Race to the Top program established under the American Recovery and Reinvestment Act. The Education Department plans to issue a final competition notice and application guidance for the assessment funding in March. (“Starting Gun Sounds for ‘Race to the Top’,” this issue.)

The ambitious goals for the assessments include providing teachers with more-useful instructional information, measuring student growth, and gauging teacher and principal effectiveness.

Early in the Nov. 12 hearing in Boston, Ms. Weiss sought to reassure panelists that the department wants states to build multiple ways of testing students, not just one assessment instrument that attempts to perform all those tasks.

To do so, the panelists said, state consortia should consider providing a comprehensive measurement system, including support for formative, real-time classroom instruction; benchmark tests to provide a sense of student progress over the course of the year; and higher-quality accountability tests. Each should be aligned to support an emphasis on college and career readiness, they said.

As part of that work, the experts said, funded consortia must pursue test-item formats capable of measuring higher-order critical-thinking skills, including performance-based tasks.

Such tasks—which might require students to engage in the process of scientific inquiry, write a research paper, or give an oral presentation—are typically embedded in curricula, reflective of real-world scenarios and able to provide richer information about a standard.

But the scores on such tasks tend to have lower mathematical reliability than those for standardized-test items, and the experts disagreed about whether such performance tasks could or should be integrated into school accountability scores in a fair, reliable way.

Raising an issue that has proved controversial in the past, several of the panelists invited by the Education Department to testify said that teachers should be intimately involved in the design of those tasks, even to the point of contributing to the scoring process.

“What we have found in the use of our testing program is that people become very familiar with what the standards are for their particular area for the curriculum,” said Jim Dueck, the assistant deputy minister of accountability and reporting in the Canadian province of Alberta, which relies on panels of teachers to score parts of its grade 12 tests.

Greater teacher involvement also creates better opportunities for professional development and teacher buy-in, said Jeff Nellhaus, the commissioner of education for Massachusetts.

“Teachers end up being the best ambassadors of your [testing] program when it’s being criticized,” Mr. Nellhaus said. “Having teachers involved in item development, [and] scoring of performance tasks, to the extent feasible, is critical to ensuring the quality, transparency, and integrity of the system.”

Assessment experts also encouraged Education Department officials to think carefully about how to encourage consortia that will work together effectively.

The consortia must be able to deal not only with interstate disagreements, but also with any political fallout from testing, added Henry Braun, who formerly worked for the Educational Testing Service.

“Just think about a consortium of eight states that each has a contract with a different vendor on a different schedule,” said Mr. Braun, now a professor of education and public policy at Boston College. “I think you have to recognize that there are going to be complaints. And we’re going to get a complaint that the assessment tail is not only wagging the instructional dog, but waving it around and sending it into orbit.”

The next hearings to gather input on the assessment competition will take place in Atlanta and Denver.

Related Tags:

Coverage of the American Recovery and Reinvestment Act is supported in part by grants from the William and Flora Hewlett Foundation, at www.hewlett.org, and the Charles Stewart Mott Foundation, at www.mott.org.
A version of this article appeared in the November 18, 2009 edition of Education Week as In Funding Common Assessments, Tough Challenges

Events

Student Well-Being K-12 Essentials Forum Social-Emotional Learning 2025: Examining Priorities and Practices
Join this free virtual event to learn about SEL strategies, skills, and to hear from experts on the use and expansion of SEL programs.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Professional Development Webinar
Inside PLCs: Proven Strategies from K-12 Leaders
Join an expert panel to explore strategies for building collaborative PLCs, overcoming common challenges, and using data effectively.
Content provided by Otus
Teaching Profession Key Insights to Elevate and Inspire Today’s Teachers
Join this free half day virtual event to energize your teaching and cultivate a positive learning experience for students.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Federal Educators Reeling as Trump Takes 'Sledgehammer' to Education Department Contracts
Research projects and services came to a sudden standstill as Trump abruptly revoked nearly $900 million in Education Department contracts.
10 min read
President-elect Donald Trump walks with Elon Musk before the launch of the sixth test flight of the SpaceX Starship rocket Tuesday, Nov. 19, 2024 in Boca Chica, Texas.
President-elect Donald Trump walks with Elon Musk before the launch of the sixth test flight of the SpaceX Starship rocket on Nov. 19, 2024 in Boca Chica, Texas. Musk and his Department of Government Efficiency have ended contracts totaling millions that fund data collections and educator resources at the U.S. Department of Education.
Brandon Bell/Pool via AP
Federal Trump Admin. Suddenly Cancels Dozens of Education Department Contracts
The Trump administration abruptly terminated dozens of contracts financed by the research arm of the U.S. Department of Education.
5 min read
Former President Donald Trump speaks at the Conservative Political Action Conference, CPAC 2023, March 4, 2023, at National Harbor in Oxon Hill, Md. Trump will deliver remarks Tuesday, April 4, in Florida after his scheduled arraignment in New York on charges related to hush money payments, his campaign announced Sunday.
President Donald Trump speaks at the Conservative Political Action Conference on March 4, 2023, at National Harbor in Oxon Hill, Md. His administration has abruptly canceled dozens of contracts for education research.
Alex Brandon/AP
Federal Linda McMahon Will Make Her Case to Lead Ed. Dept. as Trump Tries to Shrink It
The wrestling mogul Trump has selected to serve as education secretary will likely have to answer for moves the president has already made.
4 min read
From left, Lee Zeldin, administrator of the Environmental Protection Agency nominee; Kash Patel, FBI director nominee; Pete Hegseth, secretary of defense nominee; and Linda McMahon, education secretary nominee; gesture after the 60th Presidential Inauguration in the Rotunda of the U.S. Capitol in Washington, Monday, Jan. 20, 2025.
From left, Lee Zeldin, administrator of the Environmental Protection Agency; Kash Patel, nominee to serve as FBI director nominee; Pete Hegseth, secretary of defense; and Linda McMahon, nominee to serve as education secretary gesture after President Donald Trump's inauguration in the Rotunda of the U.S. Capitol in Washington on Jan. 20, 2025. McMahon will appear before senators on Thursday for her confirmation hearing.
Chip Somodevilla/Pool Photo via AP
Federal Trump's 3rd Week: Restrictions on Trans Athletes and Moves to Gut the Ed. Dept.
In his third week, the president continued his foray into education, gearing up to shrink the U.S. Department of Education.
7 min read
The exterior of the Department of Education Building in Washington, DC on Thursday, December 14, 2017.
The exterior of the Department of Education Building in Washington, DC on Thursday, Dec. 14, 2017. President Donald Trump is reportedly weighing an executive order that would lay the groundwork to eliminate the department.
Swikar Patel/Education Week