The city of San Francisco has ordered Apple and Google to remove dozens of AI-powered "nudify" apps from their app stores, escalating pressure on the technology companies over tools that can digitally alter images to make people appear nude without their consent.

The apps use artificial intelligence to generate fake intimate images from photographs of real people. The technology has raised growing concerns around privacy, sexual exploitation and the spread of non-consensual intimate deepfakes.

Companies Accused of Profiting From Harmful Apps

San Francisco City Attorney David Chiu accused Apple and Google of profiting from apps that enable the creation of non-consensual intimate images, arguing that both companies have a responsibility to prevent the misuse of their platforms.

According to letters sent to the companies by Chiu's office, Apple and Google had been repeatedly warned about the presence of such apps on their stores but continued to host and process payments for some of them.

The letters referenced reports from the Tech Transparency Project, which identified dozens of apps allegedly offering AI-generated non-consensual intimate images in exchange for payments processed through the companies.

The city also claimed that the two companies may have earned millions of dollars in fees from apps offering these services.

California Laws Target AI-Generated Sexual Abuse

The action comes amid stricter regulations in California targeting the creation and distribution of non-consensual deepfake pornography.

California law criminalises activity that knowingly facilitates or recklessly assists the creation of non-consensual deepfake pornography. A law passed in 2025 also allows victims to pursue civil claims against third parties that facilitate the creation or distribution of such material.

San Francisco officials warned that Apple and Google could face civil penalties if they fail to address the issue. The companies have been given 28 days to respond to the city's request.

Apple and Google Begin Removing Apps

Apple said that apps offering "nudify" services are prohibited from appearing on the App Store. The company confirmed that it had already removed three of the apps identified by the city and was terminating the accounts of their developers.

Apple also said it was working with four other developers to address policy violations, warning that the apps could be removed if the violations were not resolved.

Google similarly said that all five Play Store apps referenced in the city's letter had been suspended.

The company added that it has suspended hundreds of apps that violate its policies and restricted related search terms, including "nudify", on Google Play.

The Wider Deepfake Problem

Non-consensual deepfake pornography has historically targeted female celebrities and public figures, but AI-powered "nudify" tools have made the technology more accessible to anyone whose photographs are publicly available online.

The growing availability of these tools has increased calls for stronger safeguards from technology companies, app stores and regulators as policymakers attempt to address the misuse of generative AI.