School & District Management

Guidelines for ‘What Works’ Contract Signal Shifts

By Debra Viadero — January 23, 2007 | Corrected: February 22, 2019 2 min read

Corrected: This story originally misstated the value of the current What Works Clearinghouse contract. The story also should have made clear that while the clearinghouse gives its highest ratings to randomized-control studies, it also considers other kinds of studies that compare treatment and control groups.

The U.S. Department of Education wants its What Works Clearinghouse to become more nimble and more relevant to educators in the field over the next five years, according to bid specifications for potential contractors that the agency published last month.

The American Institutes of Research, based in Washington, currently holds a five-year, $23.4 million contract to run the project, which was begun by the department’s Institute of Education Sciences in 2002 as an online source for independent reviews of research on “what works” in education. But the AIR’s contract is due to end this year, requiring the institute to open bidding on a new one.

“I would call this a midcourse correction,” said James W. Kohlmoos, the president of the National Knowledge Industry Association, a Washington-based trade group, referring to the “statement of work” published online Dec. 19 in Federal Business Opportunities. “I think everybody who has been involved with this the first five years recognizes the need for some fixes, particularly when it comes to usability and relevance.”

Faster Turnaround Sought

As of last week, the clearinghouse featured 58 “intervention reports” on programs in character education, mathematics, early-childhood education, and other areas. But critics have complained that the reviews have been slow in coming and have too often yielded discouraging conclusions.

Experts disagree over whether the site’s rocky start is attributable to its meticulous research standards, a general lack of high-quality research in the field, or both. (“‘One Stop’ Research Shop Seen as Slow to Yield Views That Educators Can Use,” Sept. 27, 2006.)

Because the competition is ongoing, IES officials declined to comment on their vision for the clearinghouse.

But the new guidelines say the IES wants a contractor to devise a “streamlined, fast-response” review process for What Works reports. The statement of work also calls for producing reviews of the “best available evidence when rigorous research is lacking,” and for reporting information on the costs of implementing the programs and practices the clearinghouse reviews.

The plan describes a wide range of tasks, both new and continuing. For instance, it calls for widening reviews beyond randomized-control trials by including evidence from single-case studies, “high-quality” quasi-experiments, and other kinds of experimental designs in the mix.

The agenda also calls for two national registries—one with completed and ongoing randomized studies in education, and another listing the programs and practices schools are using.

In addition, the institute wants the clearinghouse to produce “practice guides,” for which the standards of evidence can be slightly lower, to give educators and policymakers quick, practical guidance on key educational or policy questions. The clearinghouse is now working on producing such publications, although none has been issued.

The institute also envisions having clearinghouse reviewers produce reviews of important new studies within 48 hours, and evaluate some of the other, continuing research projects that it funds.

Bidders have until Feb. 9 to show how they would fulfill the new work requirements. The AIR is expected to bid again.

A version of this article appeared in the January 24, 2007 edition of Education Week as Guidelines for ‘What Works’ Contract Signal Shifts


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Culturally Relevant Pedagogy to Advance Educational Equity
Schools are welcoming students back into buildings for full-time in-person instruction in a few short weeks and now is the perfect time to take a hard look at both our practices and systems to build
Content provided by PowerMyLearning
Classroom Technology Webinar Making Big Technology Decisions: Advice for District Leaders, Principals, and Teachers
Educators at all levels make decisions that can have a huge impact on students. That’s especially true when it comes to the use of technology, which was activated like never before to help students learn
Professional Development Webinar Expand Digital Learning by Expanding Teacher Training
This discussion will examine how things have changed and offer guidance on smart, cost-effective ways to expand digital learning efforts and train teachers to maximize the use of new technologies for learning.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Why School Boards Are Now Hot Spots for Nasty Politics
Nationalized politics, shifts in local news coverage, and the rise of social media are turning school board meetings into slug fests.
11 min read
Collage of people yelling, praying, and masked in a board room.
Collage by Gina Tomko/Education Week and Getty Images
School & District Management Opinion The Six Leadership Lessons I Learned From the Pandemic
These guiding principles can help leaders prepare for another challenging year—and any future crises to come.
David Vroonland
3 min read
A hand about to touch a phone.
Vanessa Solis/Education Week and Getty Images
School & District Management Fighting the Delta Variant: School Reopening Just Got a Lot More Complicated
With COVID-19 cases surging and mitigation measures waning, a perfect storm is taking shape that could undercut the safe reopening of schools.
8 min read
Students arrive for classes at Mast Academy in Miami last October.
Students arrive for classes at Mast Academy in Miami. With schools around the country set to reopen and the Delta variant causing a surge in coronavirus cases, schools leaders are trying to figure out how to keep kids and staff safe.
Lynne Sladky/AP
School & District Management Opinion When the National Education Debate Is Too Noisy, Look Local
A local network of your peers can offer not just practical advice, but an emotional safe harbor.
Christian M. Elkington
2 min read
A team of workmen on scaffolding rely on each other.
Vanessa Solis/Education Week and Getty Images