School & District Management

Guidelines for ‘What Works’ Contract Signal Shifts

By Debra Viadero — January 23, 2007 | Corrected: February 22, 2019 2 min read
  • Save to favorites
  • Print

Corrected: This story originally misstated the value of the current What Works Clearinghouse contract. The story also should have made clear that while the clearinghouse gives its highest ratings to randomized-control studies, it also considers other kinds of studies that compare treatment and control groups.

The U.S. Department of Education wants its What Works Clearinghouse to become more nimble and more relevant to educators in the field over the next five years, according to bid specifications for potential contractors that the agency published last month.

The American Institutes of Research, based in Washington, currently holds a five-year, $23.4 million contract to run the project, which was begun by the department’s Institute of Education Sciences in 2002 as an online source for independent reviews of research on “what works” in education. But the AIR’s contract is due to end this year, requiring the institute to open bidding on a new one.

“I would call this a midcourse correction,” said James W. Kohlmoos, the president of the National Knowledge Industry Association, a Washington-based trade group, referring to the “statement of work” published online Dec. 19 in Federal Business Opportunities. “I think everybody who has been involved with this the first five years recognizes the need for some fixes, particularly when it comes to usability and relevance.”

Faster Turnaround Sought

As of last week, the clearinghouse featured 58 “intervention reports” on programs in character education, mathematics, early-childhood education, and other areas. But critics have complained that the reviews have been slow in coming and have too often yielded discouraging conclusions.

Experts disagree over whether the site’s rocky start is attributable to its meticulous research standards, a general lack of high-quality research in the field, or both. (“‘One Stop’ Research Shop Seen as Slow to Yield Views That Educators Can Use,” Sept. 27, 2006.)

Because the competition is ongoing, IES officials declined to comment on their vision for the clearinghouse.

But the new guidelines say the IES wants a contractor to devise a “streamlined, fast-response” review process for What Works reports. The statement of work also calls for producing reviews of the “best available evidence when rigorous research is lacking,” and for reporting information on the costs of implementing the programs and practices the clearinghouse reviews.

The plan describes a wide range of tasks, both new and continuing. For instance, it calls for widening reviews beyond randomized-control trials by including evidence from single-case studies, “high-quality” quasi-experiments, and other kinds of experimental designs in the mix.

The agenda also calls for two national registries—one with completed and ongoing randomized studies in education, and another listing the programs and practices schools are using.

In addition, the institute wants the clearinghouse to produce “practice guides,” for which the standards of evidence can be slightly lower, to give educators and policymakers quick, practical guidance on key educational or policy questions. The clearinghouse is now working on producing such publications, although none has been issued.

The institute also envisions having clearinghouse reviewers produce reviews of important new studies within 48 hours, and evaluate some of the other, continuing research projects that it funds.

Bidders have until Feb. 9 to show how they would fulfill the new work requirements. The AIR is expected to bid again.

A version of this article appeared in the January 24, 2007 edition of Education Week as Guidelines for ‘What Works’ Contract Signal Shifts


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Assessment Webinar
The State of Assessment in K-12 Education
What is the impact of assessment on K-12 education? What does that mean for administrators, teachers and most importantly—students?
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Student Well-Being Webinar
Centering the Whole Child in School Improvement Planning and Redesign
Learn how leading with equity and empathy yield improved sense of belonging, attendance, and promotion rate to 10th grade.

Content provided by Panorama
Teaching Profession Webinar Examining the Evidence: Supports to Promote Teacher Well-Being
Rates of work dissatisfaction are on the rise among teachers. Grappling with an increased workload due to the pandemic and additional stressors have exacerbated feelings of burnout and demoralization. Given these challenges, what can the

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management How the Evolving Science on COVID Precautions Puts District Leaders in a Bind
For principals and district leaders, trying to keep schools open during the ever-evolving pandemic can be complex and a source of friction.
7 min read
Rear view of school teenage boy with face protective mask in front of the school.
School & District Management New Survey: How the Pandemic Has Made School Leadership More Stressful
Secondary school principals have reported frequent job-related stress, especially concerns about staff and student well-being.
6 min read
Illustration of figure at the center of many incoming arrows
nerosu/iStock/Getty Images
School & District Management From Principals, a Primer on Delivering Bad News
COVID and the upheavals of the last two years have raised the ante on often-emotional conversations with staff and parents.
9 min read
Conceptual image of balanced weighing the pros and cons.
Cagkan Sayin/iStock
School & District Management Opinion If You Can’t Maintain an Initiative, Maybe You Shouldn’t Do It
Schools are often really good at finding new initiatives to implement but aren't always good at maintaining. Here's a model to consider.
5 min read
Screen Shot 2022 01 21 at 7.57.56 AM