Hugging Face seems to be falling short of its stated values, especially regarding AI Uncensored models. A recent report from 404 Media revealed that Hugging Face hosts thousands of AI models that create nonconsensual images of real individuals, including many celebrities.
Despite the report being published over a week ago, many of these models remain available, with at least one model aimed at generating s**ual content using a likeness of a teenage actress.
The preview images meant to showcase the model’s outputs are often indistinguishable from actual photographs.
When subjected to a reverse image search, they yield numerous results featuring the actress as a child.
This particular model has been accessible on Hugging Face for nearly five months and is still live as of this writing. Transformer has opted not to disclose the celebrity’s name in this context.
Additionally, Transformer discovered a model on Hugging Face designed to create videos featuring the same celebrity.
The description of this model includes a reference to a film released when the actress was only 15 years old, and while the file name does not explicitly indicate it’s for p**nographic purposes, it is stored alongside many other models clearly intended for adult content.
Hugging Face also contains numerous models explicitly created to generate p**n images of female celebrities, with filenames that leave no doubt about their purpose. These models are organized within a folder that includes many others designed to depict the celebrities in various s**ual scenarios.
All of this content directly violates Hugging Face’s content policy, which prohibits s**ual content produced without explicit consent and forbids any underage nudity or s**ual material involving minors.
In both the United States and the United Kingdom, sharing non-consensual s**ual imagery is illegal, and soon it will also be illegal to create such content in the UK. However, neither country has outright banned the distribution of tools that can produce such material.
Finding this inappropriate content was relatively easy. Much of it appears to have been uploaded to Hugging Face as part of an initiative to archive CivitAI, a controversial AI platform that recently banned d**pfake-related content.
A publicly available tool allows users to easily search the CivitAI archive and locate the models hosted on Hugging Face.
Many of the so-called “models” mentioned are not traditional AI models but rather “LoRAs,” or “Low-Rank Adaptations.” These are methods to fine-tune existing image or video generation models to create images or videos of specific celebrities.
Most of the LoRAs discussed in the article are explicitly intended for use with p**nographic image generators like “BigLust” and “ReallyBigLust.”
A small number of users on Hugging Face seem to have uploaded a significant portion of CivitAI’s d*epfake p**n models, with one active user even acknowledging their connection to the CivitAI archive project in their profile.
As of now, Hugging Face has not taken action against this user or the other prolific uploaders whose accounts were examined. Shortly before this article was published, a list of URLs for the models discussed was sent to Hugging Face, and updates will follow if any actions are taken.
When approached for comment, Brigitte Tousignant, Hugging Face’s head of communications, stated that the team is constantly working to identify content that violates their guidelines, including content that is reported to them. She encouraged anyone who encounters such material to report it directly on the platform or to email specifics to [email protected].
Tousignant did not provide further information on whether the company is taking proactive measures to address these issues or if they are solely depending on user reports to find inappropriate content.
In their Teen Vogue article, Hugging Face executives claimed that society as a whole bears responsibility for tackling d**pfake p**nography. It raises questions about why a company of Hugging Face’s stature does not take more accountability for its platform.
As of July 24, after sending Hugging Face the URLs of the models mentioned in this article, some were removed, but several remain accessible, including the video model referencing the actress at 15.
Hugging Face has also not banned the prolific users mentioned, and a brief investigation by Transformer has revealed that the platform continues to host many other models from these users that are clearly intended to generate d*epfake p**nography of celebrities and influencers.
Further URLs will be sent to Hugging Face, with the hope that the company will take action against them. A responsible company valued at $4.5 billion should not rely on journalists to keep its platform free from tools that violate its own policies and cause harm to the individuals targeted.
Other Stories You May Like