School & District Management What the Research Says

Most Schools Have Early-Warning Systems. Some Kids Are Still Getting Lost

By Sarah D. Sparks — February 27, 2024 4 min read
Illustration of a warning symbol.
  • Save to favorites
  • Print

The first step to solving a problem is identifying that you have one. For schools using early-warning systems, though, the problem is identification isn’t enough.

Early-warning systems use student data to predict which students are at risk academically and intervening to keep them on track. A new study published by by the Center for Education Policy Research at Harvard University looked at one large, unnamed school district’s data system and found that it worked to improve attendance—but not for low-income students and not before students developed chronic absenteeism.

Student-data systems can be expensive to install and manage, and they require significant staff time and security to protect the student data they collect. But more than a decade of research shows changes in attendance, along with behavior problems and course grades, can together predict a student’s risk of dropping out of school as early as elementary school.

See also

Woman sitting at a desk in front of a monitor showing a database of different types of charts.
DigitalVision/Vectors/Getty

That’s why a large majority of school districts nationwide have adopted these systems—most recently with an eye to reducing chronic absenteeism, which has risen nearly 75 percent nationwide since the pandemic.

Yusuf Canbolat, a strategic-data fellow at CEPR, tracked the effects of one such early-warning system in a large urban district for the study, published this month in the journal Educational Evaluation and Policy Analysis. He found that the system was able to identify students with severe attendance problems—in other words, those who are missing more than 10 percent of class in a school year. But the system only led to improved attendance for high-income students.

“One of the important assumptions of the early-warning systems is to create this organizational culture around well-identified problems and tailor solutions based on that data,” Canbolat said. “My study indicates that it may not be true always when it comes to some persistent issues like chronic absenteeism. Data is important, but data alone does not solve the problem.”

For example, while the data system flagged students who missed 4 percent to 10 percent of class time, it only led to attendance improvements for the students with the highest rates of absenteeism, suggesting that schools did not intervene effectively—or enough—to make these students attend more consistently. While the study did not look at why the warnings led to improvements for only some students (a follow-up study is examining this), Canbolat thinks in part, the sheer number of chronically absent students may have led school staff to triage interventions to the most frequently absent students instead of resolving more minor absenteeism problems before they escalated.

This can be a common, but less effective approach to using the student data, said Marcia Davis, who was not part of the Harvard study but who has conducted several evaluations of early-warning systems. Students who have multiple warning flags often are already on educators’ and administrators’ radar, she said, but using student data to find the roots of attendance problems can allow educators to help larger numbers of students.

Davis, an associate education professor at Johns Hopkins and co-director of the Center for Social Organization of Schools, said such systems can make a difference in student performance and engagement but only when coaches actively help teachers understand and use the student data to find more “quietly struggling” students. In Davis’s own studies of early-warning systems in several states, effective coaches worked with a teaching team to analyze student data and plan interventions but also checked in with students directly. “I followed some of the coaches around,” Davis said. “They knew all the kids’ names. Students would be coming up to them for help.”

Similarly, Canbolat’s study found high-income, chronically absent students flagged by the early-warning system had significant improvements in attendance, but there was no benefit for lower-income students.

“Disadvantaged students have higher levels of absence, [and] the reasons for their absence are more difficult to influence,” Canbolat said, noting that low-income students are more likely to work or care for siblings, less likely to have access to health care, and more likely to have unstable housing or transportation. “A system may identify well, but if the solution does not fit the problem or that identification, we may not observe the expected outcome.”

Fine-tuning systems

The current study looked only at one large school district, but the results align with other research in the United States and internationally.

A consortium of eight early-warning research groups, including Johns Hopkins and the UChicago Network for College Success, have been developing new standards for early-warning systems since 2022. The EWS 2.0 consortium advised schools to couple early-warning alerts with ongoing analyses of root causes of common student problems. For example, the warning system in the current study logged missed instruction on a broad level but not whether absences were excused or unexcused nor underlying reasons, such as family vacation, health conditions, or other situations, Canbolat said.

Among the consortium’s recommendations:

  • Identify how school policies and practices can stop or speed up the decline of students who are starting to slide off track.
  • Identify the classes, grades, or times when interventions could help the most off-track students.
  • Focus on interventions that build supportive relationships between adults and students who have become disengaged.

Some researchers are also exploring how data systems could better fill in the gaps. One ongoing study of a Brazilian early-warning system has identified data on students’ relationships with peers, family, and school staff that could help educators target support.

A version of this article appeared in the March 13, 2024 edition of Education Week as Most Schools Have Early-Warning Systems. Some Kids Are Still Getting Lost

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Achievement Webinar
How To Tackle The Biggest Hurdles To Effective Tutoring
Learn how districts overcome the three biggest challenges to implementing high-impact tutoring with fidelity: time, talent, and funding.
Content provided by Saga Education
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Student Well-Being Webinar
Reframing Behavior: Neuroscience-Based Practices for Positive Support
Reframing Behavior helps teachers see the “why” of behavior through a neuroscience lens and provides practices that fit into a school day.
Content provided by Crisis Prevention Institute
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Mathematics Webinar
Math for All: Strategies for Inclusive Instruction and Student Success
Looking for ways to make math matter for all your students? Gain strategies that help them make the connection as well as the grade.
Content provided by NMSI

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

School & District Management Opinion Why Schools Struggle With Implementation. And How They Can Do Better
Improvement efforts often sputter when the rubber hits the road. But do they have to?
8 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
School & District Management How Principals Use the Lunch Hour to Target Student Apathy
School leaders want to trigger the connection between good food, fun, and rewards.
5 min read
Lunch hour at the St. Michael-Albertville Middle School West in Albertville, Minn.
Students share a laugh together during lunch hour at the St. Michael-Albertville Middle School West in Albertville, Minn.
Courtesy of Lynn Jennissen
School & District Management Opinion Teachers and Students Need Support. 5 Ways Administrators Can Help
In the simplest terms, administrators advise, be present by both listening carefully and being accessible electronically and by phone.
10 min read
Images shows colorful speech bubbles that say "Q," "&," and "A."
iStock/Getty
School & District Management Opinion When Women Hold Each Other Back: A Call to Action for Female Principals
With so many barriers already facing women seeking administrative roles, we should not be dimming each other’s lights.
Crystal Thorpe
4 min read
A mean female leader with crossed arms stands in front of a group of people.
Vanessa Solis/Education Week via Canva