Law & Courts

What a Proposed Ban on AI-Assisted ‘Deep Fakes’ Would Mean for Cyberbullying

By Alyson Klein — January 12, 2024 2 min read
AI Education concept in blue: A robot hand holding a pencil.
  • Save to favorites
  • Print

Last fall, students in New Jersey and Washington state used artificial intelligence tools to create fake, pornographic images of their female classmates.

If bipartisan legislation recently introduced in Congress is enacted, these kinds of activities would be against federal law and students who undertake them could be on the hook for thousands of dollars in damages.

The legislation—nicknamed the “No AI Fraud Act”—gives “all Americans the tools to protect their digital personas,” said Rep. Madeline Dean, D-Pa., who introduced the bill with Rep. María Elvira Salazar, R-Fla., “By shielding individuals’ images and voices from manipulation, the [bill] prevents artificial intelligence from being used for harassment, bullying, or abuse.”

The bill text specifically references the New Jersey incident, citing it as a reason that legislation is needed. “From October 16 to 20, 2023, AI technology was used to create, false, non-consensual intimate images of high school girls in Westfield, N.J,” it says. It also highlights other incidents where AI created images of celebrities and others that were used without permission, such as an ad that used the actor Tom Hanks’ face to advertise a dental plan.

Specifically, the bill would make it clear that every individual’s likeness and identity is protected, and everyone has the right to control the use of their own image and voice.

It would allow people to sue for thousands of dollars in damages if they have been negatively impacted—including emotionally—when others create or spread AI frauds using their identifying characteristics, without their permission.

At least five states—Indiana, New Hampshire, New Jersey, Utah, and Washington—have introduced bills for upcoming legislative sessions to deal with deepfakes, said Amelia Vance, the president of the Public Interest Privacy Center, a nonprofit that works on child and student data privacy issues.

Educators have been warily eyeing the events in New Jersey and Washington, she said.

“It’s obviously causing massive concern across the country. You have a lot of districts who are saying they don’t know what to do about it,” Vance said. “Despite open First Amendment questions, it seems like there is solid legal ground for legislators and others to pass laws restricting these fabricated, intimate or sexually explicit images and depictions.”

But Vance isn’t sure whether the proposed laws—federal or state—are as necessary when it’s “kids generating these images of other kids,” she said.

“Kids are like, ‘Oh, I wonder if I could do this!’” she said, equating it to when past generations might take a yearbook photo of their teacher’s face and place it on the body of, say, a dragon or monster and pass it around class.

Vance emphasized the importance of clear policies from districts for students to understand that distributing AI-generated images of classmates is inappropriate, against the rules, and has consequences.

When those policies are violated, schools can already discipline students in age-appropriate ways, Vance said. State cyberbullying laws can already be used to bring in local law enforcement if schools need to stop the distribution of AI-created intimate images at school, she added.

“It is great these bills are being put forward, it will clarify the landscape more generally, which will hopefully keep more 12-year-olds from experimenting,” Vance said. “But it isn’t absolutely necessary to address the problem in schools specifically.”


Jobs Virtual Career Fair for Teachers and K-12 Staff
Find teaching jobs and other jobs in K-12 education at the EdWeek Top School Jobs virtual career fair.
English-Language Learners Webinar English Learners and the Science of Reading: What Works in the Classroom
ELs & emergent bilinguals deserve the best reading instruction! The Reading League & NCEL join forces on best practices. Learn more in our webinar with both organizations.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Teaching Webinar
Challenging the Stigma: Emotions and STEM
STEM isn't just equations and logic. Join this webinar and discover how emotions fuel innovation, creativity, & problem-solving in STEM!
Content provided by Project Lead The Way

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
View Jobs
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
View Jobs
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
View Jobs
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.
View Jobs

Read Next

Law & Courts School District Lawsuits Against Social Media Companies Are Piling Up
More than 200 school districts are now suing the major social media companies over the youth mental health crisis.
7 min read
A close up of a statue of the blindfolded lady justice against a light blue background with a ghosted image of a hands holding a cellphone with Facebook "Like" and "Love" icons hovering above it.
Law & Courts In 1974, the Supreme Court Recognized English Learners' Rights. The Story Behind That Case
The Lau v. Nichols ruling said students have a right to a "meaningful opportunity" to participate in school, but its legacy is complex.
12 min read
Associate Justice of the U.S. Supreme Court William O. Douglas is shown in an undated photo.
U.S. Supreme Court Justice William O. Douglas, shown in an undated photo, wrote the opinion in <i>Lau</i> v. <i>Nichols</i>, the 1974 decision holding that the San Francisco school system had denied Chinese-speaking schoolchildren a meaningful opportunity to participate in their education.
Law & Courts Supreme Court Declines to Hear School District's Transgender Restroom Case
The case asked whether federal law protects transgender students on the use of school facilities that correspond to their gender identity.
4 min read
People stand on the steps of the U.S. Supreme Court on Feb. 11, 2022, in Washington, D.C.
People stand on the steps of the U.S. Supreme Court on Feb. 11, 2022, in Washington, D.C.
Mariam Zuhaib/AP
Law & Courts Supreme Court Declines Case on Corporal Punishment for Student With Autism
The justices refused to hear the appeal of an 11-year-old Louisiana student who alleges that two educators slapped her on her wrists.
3 min read
The Supreme Court building is seen on Capitol Hill in Washington, Jan. 10, 2023.
The Supreme Court building is seen on Capitol Hill in Washington, Jan. 10, 2023.
Patrick Semansky/AP