Chinese tech giant Alibaba recently introduced Wan 2.1, an advanced AI-powered video generation model, as an open-source tool on GitHub. The model, designed to enhance AI-driven video creation, provides users with the ability to freely modify and experiment with its capabilities. However, within just 24 hours of its release, Wan 2.1 was swiftly adopted by communities producing AI-generated adult content, raising ethical concerns.
AI Model Quickly Used for Explicit Content
As soon as Wan 2.1 became available, the AI pornography community began using it to generate and distribute explicit videos. Online groups known for creating and sharing nonconsensual AI-generated intimate media also took notice, praising the model’s advanced motion-handling capabilities. This rapid adoption highlights a growing issue with open AI models: while they democratize access to cutting-edge technology, they also open the door for potential misuse.
A Telegram user in a group dedicated to AI-generated adult content compared Wan 2.1 to Hunyuan, another AI video model released by Tencent in December. The user expressed excitement about Wan 2.1’s superior ability to handle complex video motions, underscoring the speed at which AI-generated adult content is evolving.
Modified AI Models Spreading Rapidly
The Civitai platform, known for hosting modified AI models, quickly became a hub for altered versions of Wan 2.1. Just hours after its launch, multiple pornographic AI models based on Wan 2.1 appeared on the site, where users eagerly downloaded and shared their creations. One of the earliest modified versions, “Wan-AI 万相/ Wan2.1 Video Model,” was posted only a few hours after Alibaba’s release.
Data from Civitai’s model pages reveals that these altered versions have already been downloaded hundreds of times. While the platform allows users to share AI models designed for various creative purposes, including realistic human depictions and adult content, it explicitly bans nonconsensual material. However, as previous reports have highlighted, there is little preventing users from downloading these models and using them elsewhere for unethical purposes.
The Challenge of Regulating Open AI Models
The rapid adoption of Wan 2.1 for explicit content has once again sparked debate about the risks of open-source AI technology. Experts argue that AI companies must take greater responsibility for how their models are used, as the lack of built-in safeguards can enable unethical applications, particularly in deepfake pornography and nonconsensual media creation.
While AI developers often claim their tools are designed for legitimate and creative use, enforcement against misuse remains a major challenge. With AI-generated content advancing at an unprecedented pace, regulatory bodies may soon face increased pressure to establish ethical guidelines and prevent exploitation.
As concerns grow, the question remains: Will Alibaba address the misuse of Wan 2.1, or will it follow the path of previous AI models left vulnerable to ethical abuse?
