College & Workforce Readiness

Studies Explore Reasons for ‘Fade-Out’ Effect

By Sarah D. Sparks — January 26, 2016 6 min read
  • Save to favorites
  • Print

It can take years of effort for educators and researchers to identify an intervention that really, truly improves student achievement, so it’s a source of universal frustration that even the strongest, most promising effects tend to vanish after a few years.

That’s why a new wave of research projects are trying to understand what causes fade-out in education programs, to rethink how educators evaluate the staying power of a program’s benefits, and to identify the types of interventions that may have long-lasting effects for children.

Among those efforts, the Institute of Education Sciences last week announced more than $26 million in grants to create a network of teams around the country focused on finding ways to stop preschool benefits from fading over the elementary grades.

“We believe these networks will lead to important advances in early-childhood education,” said Thomas Brock, the commissioner of the National Center for Education Research, which is part of the IES. “The idea is for the network teams to develop a deeper understanding of problems and solutions surrounding the issue, and then share what they have learned with policymakers and practitioners to improve teaching and learning for all students.”

Cognitive Impacts in Early-Childhood Education

In a forthcoming analysis of 67 early-childhood-education programs found to have significant benefits, researchers at the University of California, Irvine, and Duke University found that most results faded within a few years.

BRIC ARCHIVE

SOURCE: “Persistence and Fadeout in the Impacts of Child and Adolescent Interventions,” Drew Bailey, Greg S. Duncan, Candice Odgers, Winnie Yu

It makes sense to start with early-childhood education, which has proven particularly nettlesome for educators when it comes to holding onto immediate gains. Studies of the federal Head Start program, Tennessee’s voluntary prekindergarten, and even the famous Perry Preschool Project all showed significant early academic gains for students that regressed as children moved through elementary school. Perry Preschool’s academic gains dropped by more than half from age 5, shortly after students left the program, to age 8.

The Long View

Two comprehensive and highly regarded early-childhood education programs, the Perry Preschool Project in the 1960s and the Abecedarian Program in North Carolina in the 1970s, each followed their students for decades—long enough for so-called “sleeper” benefits to emerge, such as higher high school graduation rates and lower adult crime rates for participants. But it remains difficult to find the path through the fading early results to the later benefits.

“It’s really nice that Abecedarian and Perry showed these later-emerging effects on life outcomes, but we don’t have a great understanding of why,” said Drew Bailey, an assistant education professor studying fade-out at the University of California, Irvine. “Was it because students knew more math, or their personalities changed, or Perry reduced some risks and improved opportunities at a critical time in their development? It’s probably some combination of all that.”

If there was a “CSI: Education,” researchers like Bailey and John Protzko would be the ones dusting the body for fingerprints and lining up ballistics trajectories.

In two separate studies, the researchers and their colleagues are piecing together narratives of what happened to more than 100 studies’ worth of promising education programs which showed benefits that faltered and faded over the years.

Comparing ‘Trajectories’

“One problem is people don’t look at the trajectories of treatment and control groups separately; they just look at the difference between them,” Bailey said. “If the treatment is fading out because the treatment group is getting worse, that means something quite different than if the control group is catching up.”

Best Bets for Lasting Improvement

Researchers at the University of California, Irvine, and Duke University are developing a framework to identify the targets for educational interventions that could lead to strong, sustained improvements for students.
The most promising targets aim to improve skills, beliefs, and behaviors in the sweet spot of three kinds of critical areas, those that are:

BRIC ARCHIVE

SOURCE: “Persistence and Fadeout in the Impacts of Child and Adolescent Interventions,” Drew Bailey, Greg S. Duncan, Candice Odgers, Winnie Yu

In a 2015 meta-analysis in the journal Intelligence, Protzko, a postdoctoral scholar in cognitive science at the University of California, Santa Barbara, analyzed data on nearly 7,600 participants in 39 randomized controlled trials of programs designed to improve students’ intelligence. The programs included educational interventions, like preschool and summer school, and nonacademic programs like nutritional supplements for pregnant women. In particular, Protzko looked at how students fared after participating in a program that had been shown to statistically, significantly improve intelligence immediately after the program ended.

Over time, the benefits of each program faded, regardless of how long or intense it was initially. Moreover, interventions that started earlier in a child’s life “were no more effective and lasted no longer” than those begun later, Protzko found.

After analyzing the patterns of fading results, Protzko suggested that most gains in IQ fade within a year or two because the students who saw results from the intervention adapted to less-enriched academic environments.

“It’s easy to think of this in terms of loss—you raised intelligence, and now these kids have lost it,” Protzko said. “But adaptation is a better way to think about it. When you remove the more challenging environment [of the intervention], the students adapt to the level of cognitive challenge they have.”

Nearly all of the students in the experiments that Protzko studied were from low-income backgrounds, and he noted that it’s impossible to tell whether they did not look for or simply could not find ways to continue to challenge themselves after the intervention was over. Either way, their gains seemed to shrink over time, like the muscles of a runner who trained for a marathon and then stopped running.

Bailey and colleagues at UC-Irvine and Duke University suggested interventions must be seen as pieces in the ongoing process of education rather than attempts to create silver bullets.

They analyzed 67 early-childhood intervention programs that showed significant cognitive effects for students between 1960 and 2007. (Several of these overlapped with those that Protzko studied.) Like Protzko, they found that those gains dropped by half in the first 12 months following the interventions, and declined by half again in the next year or two, becoming insignificant.

Unlike Protzko, however, the researchers from UC-Irvine and Duke suggest that the students who participated in the intervention continued to learn at the same rate in the years that followed, as the control-group students caught up.

A New Framework

Bailey and his colleagues are now developing a framework for identifying when an intervention is likely to produce longer-lasting results. To cause long-lasting benefits for children, an intervention must target skills, capacities, behaviors, or beliefs with a “trifecta” of characteristics:

• They must be malleable, or capable of being changed by the educator or school. For example, the researchers noted that “conscientiousness” as a personality trait has been closely associated with students’ school grades and later job performance, but it has proven very stable over a person’s life.

• They must be fundamental to a long-term goal. For example, prepping for an end-of-year test might boost performance on that test, but generally does not contribute to a student’s long-term academic skills.

• They must not be something that students would develop on their own.

That last criterion trips up many promising interventions. For example, in a 2013 study in Perspectives in Psychological Science on early-childhood programs, Protzko found that interventions that taught parents to engage with their children while reading together raised young children’s IQ by more than 6 points, but did not affect children older than 4. That finding suggested the programs accelerated normal language development.

Bailey’s co-author, Gregory Duncan, a distinguished education professor at UC-Irvine, said educators may be able to give sustained benefits by targeting students in extremely deprived environments, such as supporting emotional self-regulation for teenagers in violent neighborhoods or households.

Educators can also take advantage of times when a short-term benefit may be all that’s needed to make a difference. For example, the H&R Block Project found providing low-income families with help applying for college financial aid during normal tax-filing sessions significantly raised the share of poor students enrolling in college.

“It’s all about being in the right place at the right time with the right kind of intervention to prevent bad things from happening to kids,” Duncan said.

A version of this article appeared in the January 27, 2016 edition of Education Week as Studies Explore Reasons Behind ‘Fade-Out’ Effect

Events

Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
Ed-Tech Policy Webinar Artificial Intelligence in Practice: Building a Roadmap for AI Use in Schools
AI in education: game-changer or classroom chaos? Join our webinar & learn how to navigate this evolving tech responsibly.
Education Webinar Developing and Executing Impactful Research Campaigns to Fuel Your Ed Marketing Strategy 
Develop impactful research campaigns to fuel your marketing. Join the EdWeek Research Center for a webinar with actionable take-aways for companies who sell to K-12 districts.

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

College & Workforce Readiness A FAFSA Calculation Error Could Delay College Aid Applications—Again
It's the latest blunder to upend the "Better FAFSA," as it was branded by the Education Department.
2 min read
Jesus Noyola, a sophomore attending Rensselaer Polytechnic Institute, poses for a portrait in the Folsom Library on Feb. 13, 2024, in Troy, N.Y. A later-than-expected rollout of a revised Free Application for Federal Student Aid, or FASFA, that schools use to compute financial aid, is resulting in students and their parents putting off college decisions. Noyola said he hasn’t been able to submit his FAFSA because of an error in the parent portion of the application. “It’s disappointing and so stressful since all these issues are taking forever to be resolved,” said Noyola, who receives grants and work-study to fund his education.
Jesus Noyola, a sophomore at Rensselaer Polytechnic Institute, stands in the university's library on Feb. 13, 2024, in Troy, N.Y. He's one of thousands of existing and incoming college students affected by a problem-plagued rollout of the revised Free Application for Federal Student Aid, or FASFA, that schools use to compute financial aid. A series of delays and errors is resulting in students and their parents putting off college decisions.
Hans Pennink/AP
College & Workforce Readiness How Well Are Schools Preparing Students? Advanced Academics and World Languages, in 4 Charts
New federal data show big gaps in students' access to the challenging coursework and foreign languages they need for college.
2 min read
Conceptual illustration of people and voice bubbles.
Getty
College & Workforce Readiness Learning Loss May Cost Students Billions in Future Earnings. How Districts Are Responding
The board that annually administers NAEP warns that recent research paints a "dire" picture of the future for America's children.
6 min read
Illustration concept of hands holding binoculars and looking through to see a graph and arrow with money in background.
Liz Yap/Education Week and iStock/Getty
College & Workforce Readiness The New FAFSA Is a Major Headache. Some High Schools Are Trying to Help
High schools are scrambling to help students navigate what was supposed to be a simpler process.
5 min read
Image of a laptop, and a red "x" for a malfunction.
IIIerlok_Xolms/iStock/Getty