Elon Musk’s AI chatbot Grok is under increasing international pressure following allegations that the technology has been employed to create sexualized images of women and children. An inquiry has been launched by the governments of countries such as France, Malaysia, and India.
The dispute revolves around the chatbot service offered by xAI, which is incorporated into Musk’s social platform X (previously Twitter). On Tuesday of this week, a strange apology post turned up on Grok’s Twitter account in regard to a particular incident from December 28, 2025. The apology took ownership of the generation of “an AI image of two young girls (estimated 12-16) in sexualized clothing for a user’s request.”
“This violated ethical standards and potentially US laws on [child sexual abuse material],” the apology read. “It was a failure in safeguards, and I’m sorry for any harm caused. xAI is reviewing to prevent future issues.”
X Faces Legal Pressure as India Demands Crackdown on the “Systemic Vulnerabilities” of Grok
The apology itself has raised questions about accountability. Defector writer Albert Burneko pointed out the absurdity of an AI system apologizing for its own actions, noting that Grok is “not in any real sense anything like an ‘I’.”
He argued this makes the apology “utterly without substance” since “Grok cannot be held accountable in any meaningful way for having turned Twitter into an on-demand CSAM factory.”
/socialsamosa/media/media_files/2026/01/05/fi-54-2026-01-05-12-09-11.png)
The problem extends beyond isolated incidents. According to reporting by Futurism, Grok has been used to create nonconsensual pornographic images and generate disturbing content depicting women being assaulted and sexually abused. These findings suggest systemic vulnerabilities in the AI’s safeguards rather than occasional glitches.
Musk responded to the growing criticism on Saturday, posting that “anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.” However, this statement doesn’t address the fundamental question of why the AI tool allows such content to be generated in the first place.
India has taken the most decisive action so far. On Friday, the country’s IT ministry issued a formal order demanding that X take immediate steps to prevent Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.”
The government gave X just 72 hours to respond or face the loss of “safe harbor” protections that currently shield the platform from legal liability for user-generated content.
Governments Struggle to Regulate a New Era of Digital Harm
France is also moving forward with legal action. The Paris prosecutor’s office confirmed to Politico that it will investigate the proliferation of sexually explicit deepfakes on X.
Three French government ministers have already reported “manifestly illegal content” to both prosecutors and a government online surveillance platform, demanding its immediate removal. The French digital affairs office is coordinating the response.
Malaysia has joined the chorus of concerned nations as well. The Malaysian Communications and Multimedia Commission released a statement expressing “serious concern” about public complaints regarding the misuse of AI tools on X, specifically mentioning “the digital manipulation of images of women and minors to produce indecent, grossly offensive, and otherwise harmful content.”
The international reaction underscores rapidly growing anxiety about the lack of sufficient controls in these AI systems, especially for those with vast numbers of users.
Unlike older challenges in content moderation by humans, AI-created material introduces new challenges because the tool becomes the production mechanism for harmful material itself.
The controversy also raises broader questions about corporate responsibility in the age of AI. If an AI system produces illegal content, who is responsible, the company that developed it, the platform on which it was hosted, or the users who prompted it?
Current legal frameworks weren’t designed for these kinds of scenarios, which has left governments struggling to apply existing laws to new technological realities.
Race Against the Clock: xAI, X, and the Global Crackdown on AI-Generated Illegal Content
As governments around the world start taking enforcement action, xAI and X are facing a challenge on whether they can achieve effective measures to comply with regulators within a short period.
The 72-hour period set by the Indian government shows that there is a lack of patience. Noticing the involvement of several countries, the impact may set precedents on how AI created content will be governed around the world.
At stake here is even higher because of the type of content being distributed, images of children in sexual contexts qualify as some of the most severe illegal content available on the internet.
