Grok AI Scandal: X Faces Global Crackdown Over Non-Consensual Deepfakes

But after an update to its image-editing capabilities, the xAI (as it has been called) chatbot by Elon Musk’s XAI, Grok is one of the most controversial artificial intelligence (AI) Chatbots created. Twitter (formerly X) account of the chatbot, which has been designed to respond when mentioned in a post or comment, was added on December 24 and allowed it to edit any public image posted on the social network. A number of users soon followed, and took advantage of this feature by requesting the AI chatbot to make sexually suggestive edits to women’s images.

Grok’s AI Image Editing Scandal

One short-view of the media tab on Grok’s official X handle highlights the grim reality that since its release, it has been abused by an algorithmic image-editing capability. Especially women users who have a public account, are particularly affected in this case where anonymous users with fake or burner accounts create non-consensual edits. In the site, sexually abusive requests are piled on and Grok is eager to follow up with women’s attire as well as “revealing bikini” or how they look in the pictures.

a 24-hour analysis of Grok’s profile by social media and deepfake researcher Genevieve Oh, according to. Bloomberg report that the – who has been investigating Grock’d profiles for over two decades — was conducted in he said “The research is an investigation into what she says about Grokov’s account.” According to reports, about 6,700 sexually suggestive images were generated by the AI chatbot every hour of the day and reflected the extent that this exploit was being used.

A number of users have also posted expressing concerns about the situation, including . One user, @joelle_lb, wrote ‘Grok has become a sexual abuse machine and it is unsafe for women & children to upload their pictures on the app. What does it mean that the engineers thought this was preventing? I hope men start to talk up when they see sexual abusers ask to digitally undress strangers without consent, this level of aggression and violation is horrifying. , ” and.

The AI chatbot has also been reported to have made sexually suggestive edits to images of children, including minors. It is said that the admins quickly removed these images from their database, but Grok has admitted and apologised for one incident publicly.

Grok’s Feature Triggers Global Crackdown

Investigations by authorities in India, Europe and Malaysia following the scale and severity of the. After its undressing edits became mainstream, The Hindu reported that X was ordered by the Ministry of Electronics and Information Technology (MeitY) on January 2, to begin a “comprehensive technical, procedural and governance-level review” of Grok.

The body knew what was going on, and was taking the matter seriously,” said Thomas Regnier (spokesman for European Commission) a statement. I don’t want this,’ . That’s a disgusting , this is appalling. It’s disgusting that this is a . That’s what we see of this, and is not in Europe,” Regnier said.

In a statement, the Malaysian Communications and Multimedia Commission said in remark ‘MCMC calls on all platforms available in Malaysia to implement safeguards consistent with Malaysia’s laws and online safety standards, particularly as regards their AI-powered features, chatbots and image manipulation tools. ” , ‘I’m sure it is worth reading.

Taking the post, Musk responded ‘Anyone who uses Grok to make illegal content will suffer the same effects as if they upload illegal material. But the businessman did not specify what was illegal, and how X and xAI intended to punish users who exploited this feature.

Additionally, a spokeswoman for either company has offered no explanation of why safeguards were not made to prevent such abuse in the first place. Grok is still fulfilling user requests for undressing people and showing them in sexually inappropriate situations at the time of writing this.