Schools largely unprepared to address AI manipulation of student photos

Apr 18, 2024 4:19:34 PM

by

A recent event at Aliso Viejo Middle School in Capistrano Unified, where a student used artificial intelligence software to create a nude photo of a 13-year-old girl by putting the girl’s face on another body,  illustrates how unprepared schools are for the rise in AI manipulation of student photos, the Orange County Register reported.  

According to the Register, the school district didn’t reach out to the girl’s stepmom until she filed a complaint more than a week after the incident, which she said was handled poorly.  The district’s investigation found that the student created AI-generated images of multiple student victims and another student shared the photos; Capistrano Unified said the students faced “disciplinary consequences,” which may have included suspension. 

What happened in Capistrano Unified is not the first such incident, the Orange County Register reported. In April, Laguna Beach High School was investigating the use of AI tools to create nude photos of students, and in March, five Beverly Hills middle school students were expelled for it. 

Experts told the Register that AI-generated sexual harassment and bullying could be occurring on most school campuses. 

“If a parent called me and asked, ‘What do I do?’ the first thing you do is go to your school district,” said Rebecca Delfino, an expert on “the intersection of the law and current events and emergencies.” “Most school districts have codes of conduct related to the behavior of their students, and they’re typically broad enough to address what would be considered harassment.”

But much like most states, California doesn’t have laws banning the use of inappropriate AI-generated images, according to the Register. 

“We’re way behind the curve,” John Pizzuro, a former police officer who led New Jersey’s task force on internet crimes against children, told the Register. “There is no regulation, policy or procedure on this.”

Editor Note: This story was originally published by EdSource.com on April 12.

Lasherica Thornton

Lasherica Thornton is EdSource’s Central Valley journalism resident. She was most recently the Engagement Reporter for The Fresno Bee’s Education Lab in Fresno, CA where her reporting earned her a John Swett Award from the California Teachers Association. Previously, she was the Education & Features Reporter for The Jackson Sun, a USA Today Network paper, where she covered the educational systems for more than 13 counties. Her work garnered recognition with the Tennessee Press Association as well as local entities. A Mississippi native, Lasherica started her journalistic career in the eighth grade as a reporter and editor for her high school newspaper. In college, she reported for her college and community newspapers and interned in Pennsylvania, covering state government and writing for six publications, including The Philadelphia Inquirer and The Pittsburgh Post-Gazette.

The Feed

Explainers

  • What's an IEP and How to Ensure Your Child's Needs Are Met?

    Ed Post Staff

    If you have a child with disabilities, you’re not alone: According to the latest data, over 7 million American schoolchildren — 14% of all students ages 3-21 — are classified as eligible for special...

  • Seeking Justice for Black and Brown Children? Focus on the Social Determinants of Health

    Laura Waters

    The fight for educational equity has never been just about schools. The real North Star for this work is providing opportunities for each child to thrive into adulthood. This means that our advocacy...

  • Why Math Identity Matters

    Lane Wright

    The story you tell yourself about your own math ability tends to become true. This isn’t some Oprah aphorism about attracting what you want from the universe. Well, I guess it kind of is, but...