Standards & Accountability

Draft Standards for ‘What Works’ Released

By Debra Viadero — November 27, 2002 2 min read
  • Save to favorites
  • Print

The Department of Education is circulating the draft guidelines it hopes to use for evaluating the studies that go into its What Works Clearinghouse.

When it’s up and running next year, the clearinghouse is intended to provide an online “one-stop shop” where policymakers and educators can go for scientific evidence for what really works in education.

The draft standards circulating this month are aimed at helping reviewers decide which studies should be included in the new research syntheses and how much weight to give them. The guidelines use hierarchies of questions that reviewers have to answer as they pore over each study.

Review the draft standards from the What Works ClearingHouse. (Requires Adobe’s Acrobat Reader.)

At one end of that spectrum are the basic questions that policymakers want answered. At the other end are the methodological questions that interest researchers more.

“One of our biggest and most exciting challenges was developing a system that could satisfy a diverse set of users,” said Harris M. Cooper, the University of Missouri- Columbia professor of psychological sciences who drafted the standards with colleague Jeffrey Valentine, a research assistant professor at the university.

Beginning on Nov. 11, the proposed criteria were posted on the clearinghouse’s Web site at www.w-w-c.org. The department is soliciting comments on them through Dec. 3. Clearinghouse developers also planned to hold a public forum here last Friday to discuss them.

‘Gold Standard’

While it’s too soon to know what educators and other researchers think of the new standards, a few experts who have seen them said they rely too heavily on particular research methodologies, such as experiments in which children are randomly assigned to either an intervention group or a comparison group.

“My feeling is that providing experimental and quasi-experimental designs as sole-source evidence is saying 100 years of research methods developed in anthropology, sociology, history, and education have no importance in defining effectiveness,” said H. Jerome Freiberg, a professor of curriculum and instruction at the University of Houston.

But Mr. Cooper said that experimental methods had to play a central role because they are recognized as the “gold standard” for determining whether an intervention actually works.

“However, these standards also maintain a place for well-designed quasi-experiments, and they also clearly indicate that random assignment is only one part of an equation that makes a study trustworthy or not,” Mr. Cooper added.

The clearinghouse plans to issue its final standards for evaluating studies by January.

A version of this article appeared in the November 27, 2002 edition of Education Week as Draft Standards for ‘What Works’ Released

Events

School & District Management Webinar EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Standards & Accountability What the Research Says More than 1 in 4 Schools Targeted for Improvement, Survey Finds
The new federal findings show schools also continue to struggle with absenteeism.
2 min read
Vector illustration of diverse children, students climbing up on a top of a stack of staggered books.
iStock/Getty
Standards & Accountability Opinion What’s Wrong With Online Credit Recovery? This Teacher Will Tell You
The “whatever it takes” approach to increasing graduation rates ends up deflating the value of a diploma.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Standards & Accountability Why a Judge Stopped Texas from Issuing A-F School Ratings
Districts argued the new metric would make it appear as if schools have worsened—even though outcomes have actually improved in many cases.
2 min read
Laura BakerEducation Week via Canva  (1)
Canva
Standards & Accountability Why These Districts Are Suing to Stop Release of A-F School Ratings
A change in how schools will be graded has prompted legal action from about a dozen school districts in Texas.
4 min read
Handwritten red letter grades cover a blue illustration of a classic brick school building.
Laura Baker, Canva