Draft Standards for ‘What Works’ Released

By Debra Viadero — November 27, 2002 2 min read
  • Save to favorites
  • Print

The Department of Education is circulating the draft guidelines it hopes to use for evaluating the studies that go into its What Works Clearinghouse.

When it’s up and running next year, the clearinghouse is intended to provide an online “one-stop shop” where policymakers and educators can go for scientific evidence for what really works in education.

The draft standards circulating this month are aimed at helping reviewers decide which studies should be included in the new research syntheses and how much weight to give them. The guidelines use hierarchies of questions that reviewers have to answer as they pore over each study.

Review the draft standards from the What Works ClearingHouse. (Requires Adobe’s Acrobat Reader.)

At one end of that spectrum are the basic questions that policymakers want answered. At the other end are the methodological questions that interest researchers more.

“One of our biggest and most exciting challenges was developing a system that could satisfy a diverse set of users,” said Harris M. Cooper, the University of Missouri- Columbia professor of psychological sciences who drafted the standards with colleague Jeffrey Valentine, a research assistant professor at the university.

Beginning on Nov. 11, the proposed criteria were posted on the clearinghouse’s Web site at The department is soliciting comments on them through Dec. 3. Clearinghouse developers also planned to hold a public forum here last Friday to discuss them.

‘Gold Standard’

While it’s too soon to know what educators and other researchers think of the new standards, a few experts who have seen them said they rely too heavily on particular research methodologies, such as experiments in which children are randomly assigned to either an intervention group or a comparison group.

“My feeling is that providing experimental and quasi-experimental designs as sole-source evidence is saying 100 years of research methods developed in anthropology, sociology, history, and education have no importance in defining effectiveness,” said H. Jerome Freiberg, a professor of curriculum and instruction at the University of Houston.

But Mr. Cooper said that experimental methods had to play a central role because they are recognized as the “gold standard” for determining whether an intervention actually works.

“However, these standards also maintain a place for well-designed quasi-experiments, and they also clearly indicate that random assignment is only one part of an equation that makes a study trustworthy or not,” Mr. Cooper added.

The clearinghouse plans to issue its final standards for evaluating studies by January.

A version of this article appeared in the November 27, 2002 edition of Education Week as Draft Standards for ‘What Works’ Released


Jobs October 2021 Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Data Webinar
Using Integrated Analytics To Uncover Student Needs
Overwhelmed by data? Learn how an integrated approach to data analytics can help.

Content provided by Instructure
Classroom Technology Webinar How Pandemic Tech Is (and Is Not) Transforming K-12 Schools
The COVID-19 pandemic—and the resulting rise in virtual learning and big investments in digital learning tools— helped educators propel their technology skills to the next level. Teachers have become more adept at using learning management

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards Opinion How the Failure of the Common Core Looked From the Ground
Steve Peha shares insights from his on-site professional-development work about why the common core failed, in a guest letter to Rick Hess.
4 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards Opinion Common Core Is a Meal Kit, Not a Nothingburger
Caroline Damon argues Rick Hess and Tom Loveless sold the common core short, claiming the issue was a matter of high-quality implementation.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards How New Common Core Research Connects to Biden's Plans for Children and Families
A study of national test scores indicate the early phase of the Common Core State Standards did not help disadvantaged students.
5 min read
results 925693186 02
Standards Opinion After All That Commotion, Was the Common Core a Big Nothingburger?
The Common Core State Standards may not have had an impact on student outcomes, but they did make school improvement tougher and more ideological.
3 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty