Student Well-Being

Students Are Sharing Sexually Explicit ‘Deepfakes.’ Are Schools Prepared?

By Lauraine Langreo — September 26, 2024 3 min read
Deepfake deep learning fake news generator modern internet technology concept
  • Save to favorites
  • Print

Schools are falling short in meeting the rising threat of artificial intelligence-enabled sexual harassment, concludes a new report from the Center for Democracy & Technology, a nonprofit that advocates for online civil liberties.

Forty percent of students and 29 percent of teachers say they know of a “deepfake” depicting individuals associated with their school being shared during the 2023-24 school year, according to the nationally representative survey of high school students, middle and high school teachers, and parents. (A deepfake is a digitally-manipulated video, photo, or audio recording created using someone’s voice and/or likeness without their permission.)

The primary perpetrators—and victims—are students, the report found.

While the act of sharing non-consensual intimate imagery is a long-standing problem in schools, the rise of generative artificial intelligence has made it easier to create and share fake intimate images, videos, or audio that seem real. In recent months, there have been several reported instances of students using AI tools to generate fake, pornographic images of their classmates and fake videos of their teachers or principals.

“The surface area for who can become a victim and who can become a perpetrator is significantly increased when anybody has access to these tools,” said Kristin Woelfel, a policy counsel for the Center for Democracy & Technology and one of the authors of the report. “There’s really no limit as to who could be impacted by this.”

For those who are victims of real or deepfake non-consensual intimate images, the experience is “scary” and “traumatic,” said Anjali Verma, the National Student Council president and a senior at a charter school in West Chester, Pa. “I’ve seen it happen with friends and people in my life.”

Students, teachers, and parents report a lack of support and awareness about deepfake non-consensual intimate imagery. For instance, few students say their school has explained what deepfakes are (19 percent), how they affect those depicted (13 percent), and who to tell at the school if they see or hear about them (15 percent), the report found.

And 60 percent of teachers and 67 percent of parents surveyed say they have not heard of their school or school district sharing policies and procedures with teachers about how to address authentic or deepfake non-consensual intimate imagery.

Still, a third of students said their school does a good job of catching students who share deepfake non-consensual intimate imagery, while 1 in 10 students who have heard of such incidents at their school said the student who shared it was never caught, according to the report.

Questions to ask to help prevent future ‘deepfake’ incidents

In the current environment, a lot of schools focus on “severe discipline” for the perpetrators, Woelfel said. Those methods might include suspension or expulsion, as well as getting law enforcement involved, she said.

The problem, Woelfel said, is that there is almost no focus on preventing the conduct in the first place and on supporting the victim after the incident.

Woelfel and Anjali acknowledged that schools need a lot of guidance from policymakers in order to have better response and prevention strategies, but they had some suggestions for where schools can start.

For prevention, Woelfel said schools need to better educate students and staff about deepfakes, asking questions such as:

  • What is a deepfake?
  • What is the harm of creating one?
  • What are the consequences of making and sharing them?
  • Who can they go to when they see or hear about these incidents?

Education and awareness shouldn’t just start at the high school level, Anjali emphasized. It should be a conversation that begins in elementary school, in age-appropriate ways.

“We have to start students very young, making sure that they’re aware of the [digital] world and the amount of power that comes with having this technology access,” Anjali said.

Support for victims could include providing counseling and resources for how to get deepfakes taken down if they were posted online, Woelfel said.

It’s also important to “take a step back and reevaluate” the school climate to ensure that students feel “empowered” to tell an adult when something bad has happened, Anajli said.

“We have to make sure there’s an environment where students are able to come to administration about these things without the fear of being judged,” she added.

The Center for Democracy & Technology survey included 1,316 9th- to 12th-grade students, 1,006 6th- to 12th-grade teachers, and 1,028 parents of 6th- to 12th-grade students. It was conducted this summer.

Events

School & District Management Webinar EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
What issues are keeping K-12 leaders up at night? Join us for EdMarketer Quick Hit: What’s Trending among K-12 Leaders?
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Artificial Intelligence Webinar
Teaching Students to Use Artificial Intelligence Ethically
Ready to embrace AI in your classroom? Join our master class to learn how to use AI as a tool for learning, not a replacement.
Content provided by Solution Tree
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Empowering Students Using Computational Thinking Skills
Empower your students with computational thinking. Learn how to integrate these skills into your teaching and boost student engagement.
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Student Well-Being Download Traumatic Brain Injuries Are More Common Than You Think. Here's What to Know
Here's how educators can make sure injured students don't fall behind as they recover.
1 min read
Illustration of a female student sitting at her desk and holding hands against her temples while swirls of pencils, papers, question marks, stars, and exclamation marks swirl around her head.
iStock/Getty
Student Well-Being How Teachers Can Help LGBTQ+ Students With Post-Election Anxiety
LGBTQ+ crisis prevention hotlines have seen a spike in calls from youth and their families.
6 min read
Photo of distraught teen girl.
Preeti M / Getty
Student Well-Being Schools Are Eerily Quiet About the Election Results, Educators Say
Teachers say students' reactions to Trump's win are much more muted than in 2016.
6 min read
Republican presidential nominee former President Donald Trump greets Republican vice presidential nominee Sen. JD Vance, R-Ohio, at an election night watch party at the Palm Beach Convention Center on Nov. 6, 2024, in West Palm Beach, Fla.
Republican presidential nominee former President Donald Trump greets Republican vice presidential nominee Sen. JD Vance, R-Ohio, at an election night watch party at the Palm Beach Convention Center on Nov. 6, 2024, in West Palm Beach, Fla.
Evan Vucci/AP
Student Well-Being Student Journalists Want to Cover Politics. Not Everyone Agrees They Should
Student journalists are grappling with controversial topics—a lesson in democracy that's becoming increasingly at risk for pushback.
7 min read
Illustration of a paper airplane made from a newspaper.
DigitalVision Vectors