Student Achievement

COVID Hurt Student Learning: Key Findings From a Year of Research

By Sarah Schwartz — November 30, 2022 5 min read
Illustration of Covid-19 impacting 3 years of school
  • Save to favorites
  • Print

Dozens of studies have come out over the past months concluding that the pandemic had a negative—and uneven—effect on student learning.

National analyses have shown that students who were already struggling fell further behind than their peers, and that Black and Latino students experienced greater declines in test scores than their peers.

But taken together, what implications do they have for school and district leaders looking for a path forward?

Here are four questions and answers, based on what we’ve learned from the most salient studies, that dig into the evidence.

Did students who stayed in remote learning longer fare worse than those who learned in person?

Generally, yes—but not in every single instance.

School buildings shut down in spring 2020. By fall 2021, most students were back learning in person. But schools took a variety of different approaches in the middle, during the 2020-21 school year.

Several studies have attempted to examine the effects of the choices that districts made during that time period. And they found that students who were mostly in-person fared better than students who were mostly remote.

An analysis of 2021 spring state test data across 12 states found that districts that offered more access to in-person options saw smaller declines in math and reading scores than districts that offered less access. In reading, the effect was much larger in districts with a higher share of Black and Hispanic students.

Assessment experts, as well as the researchers, have urged caution about these results, noting that it’s hard to draw conclusions from results on spring 2021 state tests, given low rates of participation and other factors that affected how the tests were administered.

But it wasn’t just state test scores that were affected. Interim test scores—the more-frequent assessments that schools give throughout the year—saw declines too.

Another study examined scores on the Measures of Academic Progress assessment, or MAP, an interim test developed by NWEA, a nonprofit assessment provider. Researchers at NWEA, the American Institutes for Research, and Harvard examined data from 2.1 million students during the 2020-21 school year.

Students in districts that were remote during this period had lower achievement growth than students in districts that offered in-person learning. The effects were most substantial for high-poverty schools in remote learning districts.

Still, other research introduces some caveats.

The Education Recovery Scorecard, a collaboration between researchers at Stanford and Harvard, analyzed states’ scores on the 2022 National Assessment of Educational Progress. They compared these scores to the average amount of time that a district in the state spent in remote learning.

For the most part, this analysis confirmed the findings of previous research: In states where districts were remote longer, student achievement was worse. But there were also some outliers, like California. There, students saw smaller declines in math than average, even though the state had the highest closure rates on average. The researchers also noted that even among districts that spent the same amount of time in 2020-21 in remote learning, there were differences in achievement declines.

Are there other factors that could have contributed to these declines?

It’s probable. Remote learning didn’t take place in a vacuum, as educators and experts have repeatedly pointed out. But there’s not a lot of empirical evidence on this question just yet.

Children switched to virtual instruction as the pandemic unfolded around them—parents lost jobs, family members fell sick and died. In many cases, the school districts that chose remote learning served communities that also suffered some of the highest mortality rates from COVID.

The NWEA, AIR, and Harvard researchers—the group that looked at interim test data—note this. “It is possible that the relationships we have observed are not entirely causal, that family stress in the districts that remained remote both caused the decline in achievement and drove school officials to keep school buildings closed,” they wrote.

The Education Recovery Scorecard team plans to investigate the effects of other factors in future research, “such as COVID death rates, broadband connectivity, the predominant industries of employment and occupations for parents in the school district.”

Most of this data is from the 2020-21 school year. What’s happening now? Are students making progress?

They are—but it’s unevenly distributed.

NWEA, the interim assessment provider, recently analyzed test data from spring 2022. They found that student academic progress during the 2021-22 school did start to rebound.

But even though students at both ends of the distribution are making academic progress, lower-scoring students are making gains at a slower rate than higher-scoring students.

“It’s kind of a double whammy. Lower-achieving students were harder hit in that initial phase of the pandemic, and they’re not achieving as steadily,” Karyn Lewis, the lead author of the brief, said earlier in November.

What should schools do in response? How can they know where to focus their efforts?

That depends on what your own data show—though it’s a good bet that focusing on math, especially for kids who were already struggling, is a good place to start.

Test results across the board, from the NAEP to interim assessment data, show that declines have been larger in math than in reading. And kids who were already struggling fell further behind than their peers, widening gaps with higher-achieving students.

But these sweeping analyses don’t tell individual teachers, or even districts, what their specific students need. That may look different from school to school.

“One of the things we found is that even within a district, there is variability,” Sean Reardon, a professor of poverty and inequality in education at Stanford University and a researcher on the Education Recovery Scorecard, said in a statement.

“School districts are the first line of action to help children catch up. The better they know about the patterns of learning loss, the more they’re going to be able to target their resources effectively to reduce educational inequality of opportunity and help children and communities thrive,” he said.

Experts have emphasized two main suggestions in interviews with Education Week.

  • Figure out where students are. Teachers and school leaders can examine interim test data from classrooms or, for a more real-time analysis, samples of student work. These classroom-level data are more useful for targeting instruction than top-line state test results or NAEP scores, experts say.
  • Districts should make sure that the students who have been disproportionately affected by pandemic disruptions are prioritized for support.

“The implication for district leaders isn’t just, ‘am I offering the right kinds of opportunities [for academic recovery]?’” Lewis said earlier this month. “But also, ‘am I offering them to the students who have been harmed most?’”

A version of this article appeared in the December 14, 2022 edition of Education Week as COVID Hurt Student Learning: Four Key Findings from A Year of Research

Events

Classroom Technology K-12 Essentials Forum How to Teach Digital & Media Literacy in the Age of AI
Join this free event to dig into crucial questions about how to help students build a foundation of digital literacy.
School & District Management K-12 Essentials Forum Principals, Lead Stronger in the New School Year
Join this free virtual event for a deep dive on the skills and motivation you need to put your best foot forward in the new year.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Privacy & Security Webinar
Navigating Modern Data Protection & Privacy in Education
Explore the modern landscape of data loss prevention in education and learn actionable strategies to protect sensitive data.
Content provided by  Symantec & Carahsoft

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Student Achievement Spotlight Spotlight on Secondary Intervention
This Spotlight will help you measure the connection between tutoring, attendance, better test scores, and more.
Student Achievement Opinion Does Getting Rid of the 'Zero' Fuel Grade Inflation?
Not everyone thinks this student grading practice is a good idea, including some researchers and educators.
9 min read
Image shows a multi-tailed arrow hitting the bullseye of a target.
DigitalVision Vectors/Getty
Student Achievement What the Research Says How to Get Summer School Right (Hint: It’s Not Just About Academics)
A new study finds a blend of remedial and enrichment activities may improve summer programs' attendance and their effectiveness.
6 min read
Teacher Monica Villegas, an exchange teacher from Mexico, instructs students at the Twin Falls School District's migrant summer school at Oregon Trail Elementary School in Twin Falls, Idaho, on June 1, 2016. A migrant summer school helps fill education gaps while keeping children out of farm fields.
Teacher Monica Villegas, an exchange teacher from Mexico, instructs students at the Twin Falls School District's migrant summer school at Oregon Trail Elementary School in Twin Falls, Idaho, on June 1, 2016. A migrant summer school helps fill education gaps while keeping children out of farm fields.
Stephen Reiss/The Times-News via AP
Student Achievement Opinion How Winning the National Spelling Bee Prepared Me for High School
Studying for the bee was overwhelming at times, but the academic and emotional benefits have been invaluable, writes 9th grader Dev Shah.
Dev Shah
4 min read
 Lots arrows missed hitting target mark and only one hits the center. If at first you don't succeed, try again!
Vanessa Solis/Education Week + iStock/Getty Images