San Francisco Demands Apple and Google Remove AI 'Nudify' Apps from App Stores

Summary

San Francisco City Attorney David Chiu has issued formal legal demands to Apple and Google to remove dozens of "nudify" apps that use AI to generate non-consensual deepfake pornography from their app stores. The apps violate California law, which criminalizes the creation of non-consensual intimate images and permits victims to pursue civil action against third-party facilitators. Both companies have been repeatedly notified of these violations since January 2025 but have allegedly continued hosting and profiting from the apps.

Chiu's office warns that Apple and Google could face significant civil penalties and must respond within 28 days. According to the Tech Transparency Project, which issued reports in January and April 2025, both companies hosted dozens of apps that sold deepfake non-consensual intimate images and allegedly "steered" users toward them. The city estimates both companies have made millions in fees from these illegal services.

Apple responded by stating it has removed three apps and is terminating their developer accounts, while addressing four others for policy violations. Google claimed it has suspended all five apps referenced in the city's letter and has restricted search terms like "nudify." However, San Francisco disputes the adequacy of their responses, emphasizing that the companies have had ample notice to prevent this abuse.

• Civil penalties loom if companies don't comply within 28 days; California law enacted in 2025 allows victims to sue third-party facilitators of non-consensual intimate images