Opinion Blog


Rick Hess Straight Up

Education policy maven Rick Hess of the American Enterprise Institute think tank offers straight talk on matters of policy, politics, research, and reform. Read more from this blog.

Education Opinion

Researching ‘What Works’ in Education Isn’t Working

By Guest Blogger — November 21, 2018 4 min read
  • Save to favorites
  • Print

For a couple more weeks, Rick will be out discussing his new edited volume, Bush-Obama School Reform: Lessons Learned. While he’s away, several of the contributors are stopping by and offering their reflections on what we’ve learned from the Bush-Obama era. This week, you’ll hear from Bob Pianta, the dean at the University of Virginia’s Curry School of Education, and Tara Hofkens, a postdoctoral research associate at UVA. They will discuss the attempts by the Bush and Obama administrations to enhance educational research, what those efforts yielded, and what lessons we should learn.

“What works?” This tagline was a motto for the Bush and Obama vision for federal investment in education: Fund research that develops empirically proven solutions that improve student achievement and create infrastructure to make it available to educators. The What Works Clearinghouse (WWC) would become the go-to place for practitioners in need of tools.

In retrospect, “what works” paints an incomplete, misinformed, and perhaps even misleading picture of what we can glean from education research during the Bush and Obama years. Although much was learned, and several high-leverage programs were developed (particularly in reading), the research funded during this time provided relatively limited insights about “what works,” particularly at scale, where most large evaluations yielded small, mixed, or null effects. And we learned little about why interventions did or did not work within and across educational settings.

Other versions of “what works” attempt to address differential effectiveness of interventions, like “what works for whom” or “what works under what conditions.” The assumption is that there are “different types” of students (students who are not average, but are similar to one another). From this perspective, the challenge of finding what works at scale—and the challenge of making sense of null effects of interventions—is figuring out who the “different types” of students are and distributing an appropriate response to “those types” of students (across and within school systems).

These taglines have a lot of value: They highlight important variation in what predicts achievement and reflect educators’ commitment to supporting all students. While this takes us beyond “what works,” to significantly move student achievement, we need to not only highlight variation but also explain it. One of the lessons learned from the Bush-Obama era is that differential effectiveness may be related to the processes by which teaching and learning unfold in classrooms. Post-Bush and Obama, we might want to consider a tagline that sharpens our focus on process in context.

“How does it happen?” This tagline asks the question: How does teaching and learning shape achievement in educational settings? Admittedly, it lacks the punch of “what works.” There’s an understandable urgency to improve achievement, and it is a deeply motivating and unifying goal for researchers and policymakers. The goal is still to find out what works—with a deeper scientific understanding of the “how” of the process and the setting, or the process in settings.

From the research done in the Bush-Obama era, we have a good sense of what processes we need to better understand (e.g., self-regulation and the dynamic relations between teacher and student behavior—see our first post from earlier this week).

We know much less about the role of local factors that shape effective instruction and learning. Unlike physiological processes that unfold similarly across contexts (from the lab to the real world), teaching and learning are embedded in local factors in an ontological way. Local culture; the climate and safety of neighborhoods and schools; parental involvement; education policies and resources (the number and types of schools in the system, feeder patterns, funding, etc.); school curriculum; instructional reforms; and teacher backgrounds are just some of the factors that may work together to determine how effective instruction and learning unfold in those settings.

We could study these factors as the context for effective teaching and learning. Implementation science, for example, has shined bright lights on the local factors that influence implementation and effectiveness of interventions. A more radical idea, though, is to consider local factors as the target instead of the context of education research and interventions. In other words, we could study the local conditions under which teaching and learning improve achievement, and intervene to support those factors.

Learning isn’t something that educators do to children, and it’s not something they can make happen or make children do. What educators can do is set up the conditions under which learning is likely to happen and use measures that accurately and robustly capture what was learned (see our last blog for more thoughts on measurement). Sleep is an example. Parents can’t actually make their children fall asleep. It’s not a behavior that they can demand or directly control. Instead, parents focus on setting up the conditions under which the processes of falling and staying asleep are likely to happen.

In education, what are the conditions under which the processes of effective teaching and learning are likely to happen? To what extent are these conditions shaped or determined by characteristics that are specific to local settings, and to what extent are those characteristics common across settings? By starting local and building up, we may build a foundation for knowing “what works” and, critically, how and where it works.

Bob Pianta and Tara Hofkens

The opinions expressed in Rick Hess Straight Up are strictly those of the author(s) and do not reflect the opinions or endorsement of Editorial Projects in Education, or any of its publications.


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
What’s Next for Teaching and Learning? Key Trends for the New School Year
The past 18 months changed the face of education forever, leaving teachers, students, and families to adapt to unprecedented challenges in teaching and learning. As we enter the third school year affected by the pandemic—and
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How Data and Digital Curriculum Can Drive Personalized Instruction
As we return from an abnormal year, it’s an educator’s top priority to make sure the lessons learned under adversity positively impact students during the new school year. Digital curriculum has emerged from the pandemic
Content provided by Kiddom
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Education Judge's Temporary Order Allows Iowa Schools to Mandate Masks
A federal judge ordered the state to immediately halt enforcement of a law that prevents school boards from ordering masks to be worn.
4 min read
Iowa Gov. Kim Reynolds speaks to reporters following a news conference, Thursday, Aug. 19, 2021, in West Des Moines, Iowa. Reynolds lashed out at President Joe Biden Thursday after he ordered his education secretary to explore possible legal action against states that have blocked school mask mandates and other public health measures meant to protect students against COVID-19. Reynolds, a Republican, has signed a bill into law that prohibits school officials from requiring masks, raising concerns as delta variant virus cases climb across the state and schools resume classes soon. (AP Photo/Charlie Neibergall)
Education Hurricane Ida Deals New Blow to Louisiana Schools Struggling to Reopen
The opening of the school year offered teachers a chance to fully assess the pandemic's effects, only to have students forced out again.
8 min read
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021. Louisiana students, who were back in class after a year and a half of COVID-19 disruptions kept many of them at home, are now missing school again after Hurricane Ida. A quarter-million public school students statewide have no school to report to, though top educators are promising a return is, at most, weeks away, not months.
Six-year-old Mary-Louise Lacobon sits on a fallen tree beside the remnants of her family's home destroyed by Hurricane Ida, in Dulac, La., on Sept. 4, 2021.
John Locher/AP
Education Massachusetts National Guard to Help With Busing Students to School
250 guard personnel will be available to serve as drivers of school transport vans, as districts nationwide struggle to hire enough drivers.
1 min read
Massachusetts National Guard soldiers help with logistics in this Friday, April 17, 2020 file photo, at a food distribution site outside City Hall, in Chelsea, Mass. Mass. Gov. Charlie Baker on Monday, Sept. 13, 2021, activated the state's National Guard to help with busing students to school as districts across the country struggle to hire enough drivers.
Massachusetts National Guard soldiers help with logistics in this Friday, April 17, 2020 file photo, at a food distribution site outside City Hall, in Chelsea, Mass.
Michael Dwyer/AP
Education FDA: ‘Very, Very Hopeful’ COVID Shots Will Be Ready for Younger Kids This Year
Dr. Peter Marks said he is hopeful that COVID-19 vaccinations for 5- to 11-year-olds will be underway by year’s end. Maybe sooner.
4 min read
Dr. Peter Marks, director of the Center for Biologics Evaluation and Research in the Food and Drug Administration, testifies during a Senate health, education, labor, and pensions hearing to examine an update from federal officials on efforts to combat COVID-19 on Capitol Hill in Washington on May 11, 2021. On Friday, Sept. 10, 2021, Marks urged parents to be patient, saying the agency will rapidly evaluate vaccines for 5- to 11-year-olds as soon as it gets the needed data.
Dr. Peter Marks, director of the Center for Biologics Evaluation and Research in the Food and Drug Administration, testifies during a Senate health, education, labor, and pensions hearing to examine an update from federal officials on efforts to combat COVID-19 on Capitol Hill in Washington on May 11, 2021.
Jim Lo Scalzo/AP