San Francisco city attorney David Chiu sent Apple and Google cease-and-desist letters this week, WIRED reported. The letters demand that both companies remove 13 face-swapping apps that can generate nude or "undressed" images of real people. City officials say the tools are used overwhelmingly against women and girls.
The notices go further than a soft policy reminder. They tell Apple and Google to stop taking money from those apps and to cut business ties with the developers. Chiu's office frames hosting and monetizing the software as part of the harm, not a neutral pipe.
Apple and Google already ban some forms of deepfake porn in their store rules. Enforcement has still been uneven. New apps keep landing under soft labels like "face swap," "clothes change," or "AI editor." Users know the search terms. Moderators often chase a rebrand and a fresh developer account.
A formal municipal order carries more weight than another trust-and-safety blog post. A city attorney can force a paper trail. Other cities and state attorneys general can copy the letter almost wholesale. Platforms that ignore formal notice invite harder questions later about revenue and how long the apps stayed live.
The 13 named titles matter less than the pattern. If the stores comply quickly, expect a temporary clean-up and then clones under new names. If they resist, the fight moves into court filings and longer timelines. Either path is messy for people waiting on takedowns.
For anyone shipping consumer AI image tools, the letters are a compliance warning. Nonconsensual intimate deepfakes are illegal in a growing list of jurisdictions. "We only sell a face-swap utility" is a weak shield when the product markets undressing real people. Store distribution does not put a company outside that problem.
Watch for public responses from Apple and Google. Watch whether the listed apps vanish within days. That timeline shows how seriously the platforms treat a municipal order versus a general policy update. Similar letters outside California would push store policy closer to a national standard.
Parents and schools already deal with harassment that spreads faster than reporting flows can keep up. Platform rules that only work after viral harm are not enough. Formal orders put the cost on store operators who already hold the kill switch for distribution.
Legitimate photo editors should not get swept up in a blunt purge. That means platforms need better classification, not only mass delisting. Victims still need faster reporting paths that work across mirrors and reuploads.
Researchers and watchdog groups have already shown how often dual-use face-swap apps slip past store screens. Soft marketing language is part of the playbook. A city attorney putting both platforms on formal notice raises the odds of copycat actions elsewhere.