Education Opinion

Broader Evidence for Bigger Impact?

By Robert E. Slavin — September 20, 2012 2 min read
  • Save to favorites
  • Print

Harvard’s Lisbeth Schorr is one of America’s most thoughtful observers of social innovations. In a recent article she discusses her concerns about the growing focus in government on programs with evidence from randomized experiments. She’s glad to see the rise of experimentation to evaluate well-defined interventions with clear theories of action, but worries that a focus on experimentally proven programs will overly limit reformers to approaches that lend themselves to experiments.

Most of Schorr’s concerns are valid; there are indeed some kinds of programs that appear to be effective but are just too complex or localized to be readily evaluated in randomized experiments. She gives the Harlem Children’s Zone as an example. Yet I would also argue that she is worrying far too soon.

The evidence-based revolution that I write about in this blog is far from dominant in education or any other area of children’s services. In fact, it’s hardly gotten started. In education, the only serious investment in evidence-base reform is Investing in Innovation (i3), which is building up the capacity and evidence base of proven and promising practices but does not require or even provide incentives for schools to use proven programs. Quite to the contrary, the really big federal programs, such as Title I, School Improvement Grants (SIG), and Race to the Top, do not contain any encouragement, much less mandate, for schools to use proven programs. With the possible exception of programs resembling Nurse-Family Partnerships, programs for children outside of PK-16 education are also just dipping a toe in the evidence pool, at best.

While Schorr is correct in saying that not everything lends itself to experiments, there is far more that does. Examples would include instructional reforms in every subject and at all grade levels, dropout prevention, programs to prevent the need for special education, programs for English language learners, whole-school reform, and more. No one is arguing that schools should be required to use proven programs; they are arguing that there should be incentives for schools to use programs proven to be effective.

Just as Schorr says, we need to find an appropriate place for programs that cannot readily be evaluated in randomized experiments. But excessive concern for overdoing experimental evaluations has held back progress for decades. I hope we can embrace the exceptions without undoing the promising but still fragile progress that has been made in evidence-based reform in recent years.

Don’t forget to follow me on Facebook and Twitter!

The opinions expressed in Sputnik are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.

Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Student Well-Being Webinar
Attendance Awareness Month: The Research Behind Effective Interventions
More than a year has passed since American schools were abruptly closed to halt the spread of COVID-19. Many children have been out of regular school for most, or even all, of that time. Some
Content provided by AllHere
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
School & District Management Webinar
Ensuring Continuity of Learning: How to Prepare for the Next Disruption
Across the country, K-12 schools and districts are, again, considering how to ensure effective continuity of learning in the face of emerging COVID variants, politicized debates, and more. Learn from Alexandria City Public Schools superintendent
Content provided by Class

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Schools Get the Brunt of Latest COVID Wave in South Carolina
In the past few weeks, South Carolina has set records for COVID-19 hospitalizations and new cases have approached peak levels of last winter.
4 min read
Two Camden Elementary School students in masks listen as South Carolina Gov. Henry McMaster talks about steps the school is taking to fight COVID-19, Wednesday, Sept. 15, 2021, in Camden, S.C. McMaster has adamantly and repeatedly come out against requiring masks in schools even as the average number of daily COVID-19 cases in the state has risen since early June. (AP Photo/Jeffrey Collins)
Education More States Are Requiring Schools to Teach Native American History and Culture
Advocates say their efforts have gained some momentum with the nation’s reckoning over racial injustice since the killing of George Floyd.
3 min read
A dancer participates in an intertribal dance at Schemitzun on the Mashantucket Pequot Reservation in Mashantucket, Conn., Saturday, Aug. 28, 2021. Connecticut and a handful of other states have recently decided to mandate students be taught about Native American culture and history. (AP Photo/Jessica Hill)
Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP