A new report shows that 50 AI bots is used to create deepfakes of women on Telegram, leading to widespread exploitation. Four years after deepfake expert Henry Ajder uncovered a Telegram bot designed to “undress” women using artificial intelligence, the problem has only worsened. A new study reveals that at least 50 similar bots are now active on the platform, collectively attracting over 4 million monthly users.
These AI-powered bots are being used to generate nude images of real individuals. Some of these programs are designed to edit photos with just a few clicks, enabling users to produce images that strip clothes or depict people in explicit acts.
According to WIRED, at least two of these bots have over 400,000 monthly users, while 14 others have more than 100,000 subscribers. Henry Ajder, who initially raised concerns about these tools, described the current situation as “nightmarish,” highlighting the severe harm they pose, especially to young girls and women.
Sextortion and Psychological Impact
The rise in these deepfake bots has led to increased cases of sextortion, where manipulated images are used to blackmail victims. A recent survey by the Center for Democracy and Technology found that 40% of students in the United States have encountered deepfake generators in their educational institutions. The growing accessibility of these tools has made it easier for people to misuse them, causing emotional distress to those targeted.
Many victims have reported that 50 AI bots is used to create deepfakes of women, causing emotional distress and harm. Emma Pickering, from the UK’s largest domestic abuse organization, Refuge, spoke to WIRED about the psychological toll on victims of non-consensual intimate image (NCII) sharing. Pickering explained that victims experience feelings of humiliation, fear, and shame, which significantly impact their mental well-being. The situation is exacerbated by the lack of legal repercussions for those responsible for creating and distributing these images.
Legal Challenges and Calls for Accountability
Despite ongoing debates on how to regulate the misuse of deepfake technology, effective solutions have yet to be implemented. Legislation such as the Deepfake Accountability Act has been proposed in the United States, but it has not yet fully addressed the growing problem.
Telegram has faced criticism because 50 AI bots is used to create deepfakes of women on its platform without adequate control. Telegram, a platform known for its encrypted messaging services, has faced repeated criticism for enabling the misuse of its tools. Reports indicate that the Indian government has launched an investigation into the platform’s role in facilitating such activities, which could potentially lead to a ban.
Earlier this year, Telegram’s CEO Pavel Durov faced legal charges related to the facilitation of child pornography on the platform. Despite these legal challenges, little has changed in Telegram’s operations. Durov has argued that holding innovators personally responsible for the misuse of their technology would stifle innovation.
Social Impact on Victims
The impact of deepfake bots on victims is profound and long-lasting. Women and girls are especially vulnerable to this type of exploitation. When non-consensual intimate images (NCIIs) are created and shared, victims experience a deep sense of humiliation, fear, and shame. This can lead to severe mental health issues, including anxiety, depression, and even suicidal thoughts. The fact that many victims feel powerless to stop the spread of these images only worsens the emotional toll.
Moreover, the rise in sextortion cases is deeply alarming. Sextortion involves the use of manipulated images to blackmail victims, forcing them into further exploitation. This creates a vicious cycle of abuse, where victims are constantly living in fear of being exposed. What makes the situation even more troubling is the lack of consequences for the perpetrators. The ease with which deepfake bots can be used means that many abusers operate without fear of being caught or punished.
Also Read: OpenAI Has Appointed Dane Stuckey as CISO to Enhance Security.
