Opinion
School & District Management Opinion

Introducing: A New Series on the Practical Takeaways From Research

A new series explores what educators need to know
By Heather C. Hill & Susanna Loeb — January 21, 2020 5 min read
BRIC ARCHIVE
  • Save to favorites
  • Print

Welcome to “What Works, What Doesn’t.”

Educators and policymakers want to make good choices for schools and districts. And research can help. For people in charge of schools and classrooms starting with “what the research says” can be critical in navigating the challenges of boosting student learning and creating environments where children thrive.

Research brings to bear facts that have been collected and analyzed in purposeful, systematic, and often public ways. Its power to rise above the anecdotal is why people in medicine, business, and every type of public policy increasingly refer to it.

Yet rarely does a single research study provide irrefutable evidence that one choice is better than another, because each study takes place with a particular set of schools, teachers, and students, and because each study tests a specific policy or program. And findings from single research studies often conflict; for instance, school turnaround policies may improve student achievement in one context but not in another.

In order to be useful, then, research evidence needs synthesis. Each study is a puzzle piece, telling us where different approaches to improving teaching or schools have reached their goals and where they haven’t. Some also tell us why the approach worked or didn’t work in a particular context. Only when brought together can the studies help us predict what factors are likely to be in play when we make one choice of practice or program or policy over another. While the flaws in research can be frustrating, once synthesized the evidence in many cases points us quite clearly to one choice over another. Unfortunately, those eager to learn what research has to teach often lack this sort of overview.

In this Education Week twice-a-month series, we will piece together the evidence on issues facing state and district policymakers, principals, and teachers. Look for topics such as having teachers examine student data, homework management, principal leadership-development programs, parent engagement, social-emotional learning, school finance, and STEM instructional improvement. (And we will be looking for you to suggest other topics by using #EdResearchToPractice on Twitter or submitting a comment to this essay and the others in this series.)

Policymakers and school and district leaders should be forewarned that some of the evidence we present—even for very popular programs and policies—will seem grim. Pruning back unhelpful practices creates room for new and better ones and breathing space for teachers and administrators who right now feel like they operate under the gun of too many (and sometimes competing) policies and programs.

In synthesizing research to see what practices are effective, we will care about both outcomes for students (such as achievement) and outcomes for classrooms (such as the quality of instruction)—we view classroom outcomes as important in their own right. Children deserve safe, caring, and intellectually stimulating classrooms, both because that’s their home for up to six hours a day, and because classroom instruction is the primary in-school mechanism through which children learn. Thus, we will include studies, when possible, that improve classroom outcomes, even if we do not know their effects on student outcomes.

When we do write about child outcomes, we will consider more than state standardized test scores. While such scores are important—and often critically important to the policymakers and leaders charged with raising them—many other observable child outcomes shape later-life experiences or are significant, too. Engagement in school, for example, reflects the richness of students’ day-to-day experiences and allows them to develop the capacities they need for later success. We can measure this engagement through both concrete actions, such as students’ choices to stay in school or take more challenging classes, and more abstract measures like students’ sense of connectedness to school, efficacy with difficult content, and hope for the future. Increasingly, studies address these types of important outcomes, and, where possible, we will give preference to work that sheds light on how to provide students with opportunities to develop in these ways.

A few notes about what you can expect from this project:

We are aiming to provide accessible information. Principals, district leaders, state policymakers, teachers—anyone who makes decisions about the practices and policies we discuss here—should all find something relevant.

We will try—and fail—at being comprehensive. While we will make an attempt to find every study on every topic, we will surely miss some, particularly unpublished reports and lesser-known published articles.

We will give preference to studies with rigorous designs. By rigorous designs, we generally mean studies that examine the effects of a policy or program by comparing participants with a plausibly similar group of non-participants. (Plausible similarity may be achieved through random assignment of participants to the program or to a no-treatment comparison group, but it can be achieved in other ways as well.)

Not all topics will be ripe for review. Emerging policy questions and programs, such as teacher anti-bias initiatives and personalized learning, may not have sufficient evidence to warrant a review. While we hope that we can find an evidence base on these and other similarly hot topics, we may have to leave some aside or address them later. When we do address questions without clear evidence, we will be sure to emphasize the resulting limits.

We will not be experts in all the topics you want to know about. After 40-plus combined years in academia, however, we have a lot of practice reading empirical studies. If the question is timely and the evidence supports a synthesis, we will summarize it.

We will be wrong some of the time. The only way we could be consistently correct would be to avoid addressing the complex issues that are most important for education improvement. When we are wrong (and even when we are correct), we invite discussion from other scholars, policymakers, and practitioners in the online spaces we have suggested.

Expect some guest authors. We will occasionally hand over a review to a scholar with a particularly innovative and impactful study, new and thoughtful ideas, or long experience in a field.

If research is to fulfill its promise to education, researchers have to scoop up the puzzle pieces and put together a meaningful picture for policymakers and practitioners. We look forward to writing this series, and to engaging in dialogue with you as we move forward.

Follow the Education Week Opinion section on Twitter.

Sign up to get the latest Education Week Opinion in your email inbox.
A version of this article appeared in the January 22, 2020 edition of Education Week as Weighing the Research: What Works, What Doesn’t


Commenting has been disabled on edweek.org effective Sept. 8. Please visit our FAQ section for more details. To get in touch with us visit our contact page, follow us on social media, or submit a Letter to the Editor.


Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
6 Key Trends in Teaching and Learning
As we enter the third school year affected by the pandemic—and a return to the classroom for many—we come better prepared, but questions remain. How will the last year impact teaching and learning this school
Content provided by Instructure
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Curriculum Webinar
How Data and Digital Curriculum Can Drive Personalized Instruction
As we return from an abnormal year, it’s an educator’s top priority to make sure the lessons learned under adversity positively impact students during the new school year. Digital curriculum has emerged from the pandemic
Content provided by Kiddom
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Equity & Diversity Webinar
Leadership for Racial Equity in Schools and Beyond
While the COVID-19 pandemic continues to reveal systemic racial disparities in educational opportunity, there are revelations to which we can and must respond. Through conscientious efforts, using an intentional focus on race, school leaders can
Content provided by Corwin

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Opinion The Consequence of Public-Health Officials Racing to Shutter Schools
Public-health officials' lack of concern for the risks of closing schools may shed light on Americans reticent to embrace their directives.
5 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
School & District Management Opinion Best Ways for Schools to Prepare for the Next Pandemic
Being better connected to families and the community and diversifying the education workforce are some of the ways to be ready.
14 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty
School & District Management From Our Research Center Educators' Support for COVID-19 Vaccine Mandates Is Rising Dramatically
Nearly 60 percent of educators say students who are old enough to receive COVID vaccines should be required to get them to attend school.

4 min read
Mariah Vaughn, a 15-year-old Highland Park student, prepares to receive a COVID-19 vaccine during the vaccine clinic at Topeka High School on Monday, Aug. 9, 2021.
Mariah Vaughn, 15, a student at Highland Park High School in Topeka, Kan., prepares to receive a COVID-19 vaccine at her school in August.
Evert Nelson/The Topeka Capital-Journal via AP
School & District Management 10 Ways to Tackle Education's Urgent Challenges
As the school year gets underway, we ask hard questions about education’s biggest challenges and offer some solutions.
2 min read
Conceptual Image of schools preparing for the pandemic
Pep Montserrat for Education Week