IT Infrastructure

Web Sites Gauge Proof of Whether Programs Work

By Debra Viadero — November 07, 2006 3 min read
  • Save to favorites
  • Print

A federal research center has added another Web site to the lengthening list of similar ventures that distill what the research says on “what works’’ to improve the achievement of students in grades K-12.

The new clearinghouse, called the Best Evidence Encyclopedia, or BEE, was launched earlier this fall by the Center for Data-Driven Education Reform at Johns Hopkins University in Baltimore. It adds to a growing collection of Consumer Reports-style Web sites that vet the research evidence on promising educational programs and practices. At least eight such sites exist now, the best known of which is the U.S. Department of Education’s What Works Clearinghouse.

To a degree, the Web sites grow out of the Education Department’s ongoing campaign to transform education into an evidence-based field, much like medicine.

Consumer Reports

A growing number of consumer-friendly Web sites that synthesize the research on “what works” in education and the social sciences are popping up, including:

Best Evidence Encyclopedia distills evidence from several different research groups on promising practices and interventions in education. It’s produced by the federally funded Center for Data-Driven Reform in Education, at Johns Hopkins University in Baltimore.

Blueprints for Violence Prevention at the University of Colorado in Boulder identifies programs found to be effective in reducing violent crime, bullying, delinquency, and substance abuse.

Child Trends What Works site summarizes both the research and the professional wisdom on promising programs aimed at improving the lives of children and youths.

Comprehensive School Reform Quality Center at the Washington-based American Institutes for Research (AIR) posts research reviews on schoolwide improvement efforts and educational service providers.

International Campbell Collaboration systematically reviews research evidence from around the world on social, behavioral, and educational interventions.

Poverty Action Lab at the Massachusetts Institute of Technology scientifically evaluates anti-poverty programs in developing countries.

Promising Practices Network is operated by the RAND Corp., a think tank based in Santa Monica, Calif. It highlights research-based programs shown to be effective at improving outcomes for children, youths, and families.

Social Programs That Work, produced by the Washington-based Coalition for Evidence-Based Policy, is a listing of interventions in education and various social science areas that have been evaluated through randomized studies.

What Works Clearinghouse, funded by the U.S. Department of Education and run by the AIR, contains research reviews and effectiveness ratings on a wide range of educational programs and practices.

Debra Viadero

“I can imagine that, in a few years—whether it’s the BEE or something like it—there being something that will be consulted continually and begin to matter in the kinds of choices that schools and policymakers make,” said Robert E. Slavin, the director of the Center on Data-Driven Education Reform, or CDDRE. “That would be a radical change.”

His clearinghouse has so far gathered reviews on promising programs in elementary mathematics, reading, educational technology, comprehensive school reform, and other areas. Unlike the What Works Clearinghouse, though, the BEE seeks to be a one-stop shop for practitioners, posting evaluations by other researchers as well as those that Mr. Slavin and his colleagues produce.

“Nobody who is actually looking for a math program is going to look at What Works, and then the CRSQ [Comprehensive School Reform Quality] Center, and then somewhere else,” said Mr. Slavin, referring to other organizations whose reviews are included on the new Web site. “Educators and policymakers want all this in one place so they can make a fair comparison.”

Whether all the new Web sites will ultimately complement one another—or compete—is an open question, said Gerald E. Sroufe, the director of government relations for the Washington-based American Educational Research Association.

A strength of the Best Evidence site, said Jon Baron, the executive director of the Washington-based Coalition for Evidence-Based Education, is that its format makes it easy for practitioners to quickly find the three or four programs in a particular area with the strongest research base.

“From my standpoint, that’s the most important use for a site like this,” Mr. Baron said.

Criteria Vary

But the Best Evidence Encyclopedia also uses a slightly different research standard from that of the What Works Clearinghouse.

Both efforts put a high value on randomized studies—in other words, those that randomly assign participants to either control or experimental groups—as well other types of comparisons. The difference is that the BEE also favors studies that test students in the control and experimental groups on content that both groups have had a chance to learn, Mr. Slavin says. He said his site also includes older studies in the evaluation mix—in contrast to What Works’ practice of using studies no more than 20 years old.

“In the late 1970s and early ’80s, there was a lot of interest in randomized studies and a lot of them were being done,” he said.

In fact, all the online research-review databases set slightly different standards for what counts as evidence of effectiveness.

On one end of the scale, Social Programs That Work, the site that Mr. Baron’s organization operates, screens out educational programs that have not proved their mettle through randomized studies. At the other end, another What Works site—this one produced by the nonprofit Washington-based research organization Child Trends—highlights programs recommended by experienced practitioners as well as those with research track records.

“It does create confusion that there are a bunch of these sites,” Mr. Baron said, “especially if they use different criteria.”

When Mr. Slavin’s center was launched in 2004 with a five-year, $10 million grant from the Education Department’s Institute of Education Sciences, its main mission was to help districts improve learning by analyzing their own student-achievement data. Center researchers had no plans to create their own evaluation database, Mr. Slavin says.

But delays in getting the What Works clearinghouse up to speed prompted the center to step in with its own user-friendly research syntheses for its partner districts. (“‘One Stop’ Research Shop Seen as Slow to Yield Views That Educators Can Use,” Sept. 27, 2006.)

“The key idea is not just to try to help districts understand their own data,” Mr. Slavin said, “but also to respond to the problems in practice that those reviews identify.”

A version of this article appeared in the November 08, 2006 edition of Education Week as Web Sites Gauge Proof of Whether Programs Work

Commenting has been disabled on effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
What’s Next for Teaching and Learning? Key Trends for the New School Year
The past 18 months changed the face of education forever, leaving teachers, students, and families to adapt to unprecedented challenges in teaching and learning. As we enter the third school year affected by the pandemic—and
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Curriculum Webinar
How Data and Digital Curriculum Can Drive Personalized Instruction
As we return from an abnormal year, it’s an educator’s top priority to make sure the lessons learned under adversity positively impact students during the new school year. Digital curriculum has emerged from the pandemic
Content provided by Kiddom
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

IT Infrastructure School Districts Seek Billions in New Federal Money for Connectivity, FCC Announces
The Federal Communications Commission received $5.1 billion in requests for new funding to purchase devices and improve internet access.
2 min read
Image shows two children ages 5 to 7 years old and a teacher, an African-American woman, holding a digital tablet up, showing it to the girl sitting next to her. They are all wearing masks, back to school during the COVID-19 pandemic, trying to prevent the spread of coronavirus.
iStock/Getty Images Plus
IT Infrastructure School District Data Systems Are Messed Up. A New Coalition Wants to Help
Organizations representing states and school districts have teamed up with ISTE to help make data systems more user-friendly and secure.
3 min read
Conceptual collage of arrows, icon figures, and locks
Sean Gladwell/Moment/Getty
IT Infrastructure More Families Have Internet Access. So Why Hasn't the Digital Divide Begun to Close?
A new study says low-income families’ access to the internet has soared in the past six years. But there are other barriers to connectivity.
3 min read
Glowing neon Loading icon isolated on brick wall background. Progress bar icon.
Mingirov/iStock/Getty Images Plus
IT Infrastructure Remote and Hybrid Learning Are Declining. But the 'Homework Gap' Will Still Be a Problem
Schools are returning to in-person instruction, but students' connections to the internet at home remain spotty.
2 min read
Sam Urban Wittrock, left, an advance placement World History Teacher at W.W. Samuell High School, displays a wifi hot spot that are being handed out to students in Dallas on April 9, 2020. Dallas I.S.D. is handing out the devices along with wifi hotspots to students in need so that they can connect online for their continued education amid the COVID-19 health crisis.
Sam Urban Wittrock, left, an Advanced Placement World History Teacher at W.W. Samuell High School in Dallas, displays one of the Wi-Fi hotspots that were given to district students during the pandemic.
Tony Gutierrez/AP