Education Letter to the Editor

On the What Works Clearinghouse

February 12, 2008 3 min read
  • Save to favorites
  • Print

To the Editor:

In the current era of accountability, efforts to synthesize and disseminate research findings that meet high standards are more useful than ever. Educators, parents, and the public are clamoring for objective information about products and approaches schools can use that have the potential to raise student achievement. The What Works Clearinghouse was designed to respond to this need by providing easily accessible and digestible information, based on transparent standards and objective principles.

In a recent Commentary, Robert E. Slavin argues that the clearinghouse should favor large studies and relax its standards for statistical methodologies (“The What Works Clearinghouse: Time for a Fresh Start,” Dec. 19, 2007). He recommends that the clearinghouse get more in the business of choosing what constitutes appropriate interventions by excluding some from its reviews altogether. But adopting these suggestions would take the clearinghouse in a direction that ultimately would impinge on its mission to be a trusted and reliable source of evidence about what works.

Mr. Slavin does not make a case for why his recommendations will improve clearinghouse reviews. His suggestion to omit from reviews interventions that last less than 12 weeks suggests that researchers should provide information only on what they believe are valuable interventions for educators. This is inconsistent with the mission of the What Works Clearinghouse. A research review process driven by the interests of researchers and developers is potentially rife with bias and does a disservice to educators, who are capable of making their own decisions about which interventions can help their students.

Mr. Slavin calls the clearinghouse “unaccountably inconsistent.” But all studies must meet the same standards in an area, as well as the overarching clearinghouse standards that are rooted in well-accepted principles of statistical inference. Principal investigators have some flexibility within their individual review areas, but allowing flexibility to accommodate the unique features of various areas is a strength of the clearinghouse’s methods. Review areas need to accommodate the wide-ranging scale and content of studies that naturally arises when the areas under review are as diverse as preschool literacy interventions and dropout-prevention efforts, to take two examples.

The U.S. Department of Education and the new managers of the clearinghouse recognize that more needs to be done. We are adding more reviews and creating new products based on input from decisionmakers and practitioners. The clearinghouse also is taking up the challenge of providing information about the diversity of settings, local contexts, and contradictions among studies of the same interventions.

This debate about how to evaluate and synthesize research underscores the need for an institution like the What Works Clearinghouse. Individual researchers will have different views about how standards should be defined, but educators then would be overwhelmed by a plethora of standards. And the changes advocated by Mr. Slavin would likely have the effect of further elevating his own Success for All program, which may lead other educators to question whether standards being promoted by individuals are little more than a means for advancing other objectives.

An independent entity—one whose sole purpose is to provide unbiased and objective information about what research has found about effectiveness, using transparent and clear standards—can provide a richer source of evidence that will help support the wide-ranging needs of educators.

Mark Dynarski


What Works Clearinghouse

Senior Fellow

Mathematica Policy Research Inc.

Princeton, N.J.

A version of this article appeared in the February 13, 2008 edition of Education Week as On the What Works Clearinghouse

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Ensuring Continuity of Learning: How to Prepare for the Next Disruption
Across the country, K-12 schools and districts are, again, considering how to ensure effective continuity of learning in the face of emerging COVID variants, politicized debates, and more. Learn from Alexandria City Public Schools superintendent
Content provided by Class
Teaching Profession Live Online Discussion What Have We Learned From Teachers During the Pandemic?
University of California, Santa Cruz, researcher Lora Bartlett and her colleagues spent months studying how the pandemic affected classroom teachers. We will discuss the takeaways from her research not only for teachers, but also for

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Schools Get the Brunt of Latest COVID Wave in South Carolina
In the past few weeks, South Carolina has set records for COVID-19 hospitalizations and new cases have approached peak levels of last winter.
4 min read
Two Camden Elementary School students in masks listen as South Carolina Gov. Henry McMaster talks about steps the school is taking to fight COVID-19, Wednesday, Sept. 15, 2021, in Camden, S.C. McMaster has adamantly and repeatedly come out against requiring masks in schools even as the average number of daily COVID-19 cases in the state has risen since early June. (AP Photo/Jeffrey Collins)
Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)
Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP