Find your next job fast at the Jan. 28 Virtual Career Fair. Register now.

Draft Standards for ‘What Works’ Released

By Debra Viadero — November 27, 2002 2 min read

The Department of Education is circulating the draft guidelines it hopes to use for evaluating the studies that go into its What Works Clearinghouse.

When it’s up and running next year, the clearinghouse is intended to provide an online “one-stop shop” where policymakers and educators can go for scientific evidence for what really works in education.

The draft standards circulating this month are aimed at helping reviewers decide which studies should be included in the new research syntheses and how much weight to give them. The guidelines use hierarchies of questions that reviewers have to answer as they pore over each study.

Review the draft standards from the What Works ClearingHouse. (Requires Adobe’s Acrobat Reader.)

At one end of that spectrum are the basic questions that policymakers want answered. At the other end are the methodological questions that interest researchers more.

“One of our biggest and most exciting challenges was developing a system that could satisfy a diverse set of users,” said Harris M. Cooper, the University of Missouri- Columbia professor of psychological sciences who drafted the standards with colleague Jeffrey Valentine, a research assistant professor at the university.

Beginning on Nov. 11, the proposed criteria were posted on the clearinghouse’s Web site at The department is soliciting comments on them through Dec. 3. Clearinghouse developers also planned to hold a public forum here last Friday to discuss them.

‘Gold Standard’

While it’s too soon to know what educators and other researchers think of the new standards, a few experts who have seen them said they rely too heavily on particular research methodologies, such as experiments in which children are randomly assigned to either an intervention group or a comparison group.

“My feeling is that providing experimental and quasi-experimental designs as sole-source evidence is saying 100 years of research methods developed in anthropology, sociology, history, and education have no importance in defining effectiveness,” said H. Jerome Freiberg, a professor of curriculum and instruction at the University of Houston.

But Mr. Cooper said that experimental methods had to play a central role because they are recognized as the “gold standard” for determining whether an intervention actually works.

“However, these standards also maintain a place for well-designed quasi-experiments, and they also clearly indicate that random assignment is only one part of an equation that makes a study trustworthy or not,” Mr. Cooper added.

The clearinghouse plans to issue its final standards for evaluating studies by January.

A version of this article appeared in the November 27, 2002 edition of Education Week as Draft Standards for ‘What Works’ Released


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Branding Matters. Learn From the Pros Why and How
Learn directly from the pros why K-12 branding and marketing matters, and how to do it effectively.
Content provided by EdWeek Top School Jobs
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
How to Make Learning More Interactive From Anywhere
Join experts from Samsung and Boxlight to learn how to make learning more interactive from anywhere.
Content provided by Samsung
Teaching Live Online Discussion A Seat at the Table With Education Week: How Educators Can Respond to a Post-Truth Era
How do educators break through the noise of disinformation to teach lessons grounded in objective truth? Join to find out.

EdWeek Top School Jobs

Special Education Teachers
Lancaster, PA, US
Lancaster Lebanon IU 13
Speech Therapists
Lancaster, PA, US
Lancaster Lebanon IU 13
BASE Program Site Director
Thornton, CO, US
Adams 12 Five Star Schools
Director of Information Technology
Montpelier, Vermont
Washington Central UUSD

Read Next

Standards How to Assess English-Learners' Needs From a Distance? Here's Some Help
With schools unable to conduct in-person evaluations, schools must find new ways to determine if students need English-language-learner support services.
2 min read
Standards Fact Check: Trump Administration Didn't 'Get Rid' of Common Core
U.S. Secretary of Education Betsy DeVos implied at the Conservative Political Action Conference that President Donald Trump has fulfilled a pledge to "get rid of" the Common Core State Standards. That's not true.
2 min read
Standards People Keep on Saying They're Killing the Common Core. How Dead Is It?
Florida's governor declares a standards overhaul would "remove all vestiges" of the common core. But it remains unclear how much is really changing under the Florida Benchmarks for Excellent Student Thinking.
4 min read
Standards Mismatch Seen Between New Science Tests and State Requirements
Teachers in some states worry students may face questions on topics they haven't studied on new science tests rolling out across the country.
6 min read