There are so many Nudify models on Hugging Face with little moderation
7/9 of Hugging Face’s top image editing models will “undress” images at user request without limits. AI Forensics research finds 83% of prompts requested removal of clothing; 6.7% of sexual requests were about minors. Only 3% of Spaces have output moderation.
A study conducted by the non-profit AI Forensics found that 7/9 of Hugging Face’s most popular image editing models will “undress” images at user request without limits. The group sampled 1,081 prompts over the course of a week. Of those, 83% requested the removal of clothing, while 6.7% of sexual prompts referenced minors. Only 3% of Hugging Face Spaces tested had output moderation.
Hugging Face, the world’s largest open AI model repository, has turned into an infrastructure for creating non-consensual deepfakes. While the EU and the UK move towards banning nudify apps, it’s clear that laws aren’t keeping up with technology. These apps are already accessible online and functioning.
Source: www.engadget.com
Free course
Stop reading about AI — start building with it
The free Claude Code course: your first site, tool or game — no coding. No upsells, no cross-sells — nothing to buy here.
Start free →▌ Related guides
Author
Evgenii Arsentev
PhD · Chief Executive Officer, digital health
Articles · Latest articles