Deepfake App Movely Used to Create Non-Consensual Sexual Images of High School Girls, Exposing AI Safety Gaps
Key Takeaways
- ▸Deepfake creation apps like Movely are easily accessible to teenagers with minimal age verification, enabling production of non-consensual sexual content depicting minors
- ▸Schools are unprepared to address AI-generated sexual abuse, with outdated policies that fail to protect victims and often re-traumatize them
- ▸State-level laws criminalizing deepfakes exist but lack effective enforcement mechanisms to prevent or deter misuse by juveniles
Summary
A Pennsylvania high school was rocked by a deepfake abuse incident when a 9th grade student used the iOS app Movely to create non-consensual sexually explicit images of five 14- and 15-year-old female classmates and distributed them to peers. The incident occurred at Radnor High School, ranked among the top schools in Pennsylvania, where the deepfakes circulated through the student body before victims learned what had happened. Despite Pennsylvania's 2024 law criminalizing malicious deepfakes and existing Title IX policies, the school's administration's response was criticized as inadequate, offering only to let victims leave class early—further isolating them from their peers. The incident has sparked broader conversations about the accessibility of AI-powered deepfake tools to minors, the role of schools in addressing technology-enabled sexual abuse, and the urgent need for stronger safeguards against AI-generated child sexual abuse material.
- The incident raised Title IX questions about school responsibility for off-campus, after-hours technology-enabled harassment involving students
Editorial Opinion
The Radnor High School incident exposes a dangerous gap in AI safety: deepfake creation apps targeting teenagers are commercially available with virtually no content controls or age enforcement. While Pennsylvania criminalized malicious deepfakes in 2024, this law proves ineffective when a $250 app subscription allows minors to generate CSAM-adjacent content with impunity. Tech platforms, app stores, and schools must implement immediate guardrails—age verification, consent checking, and detection systems—to prevent AI tools from being weaponized for sexual harassment. The burden cannot fall solely on victims and their families to navigate inadequate institutional responses.
