Grok Limits Image Tools to Paying Users After Deepfake Backlash

The move by Elon Musk’s social media company follows criticism that the AI chatbot was used to create non-consensual and sexually explicit images, prompting scrutiny from regulators in Britain and Europe

Elon Musk’s artificial intelligence chatbot Grok has restricted its image generation and image editing tools to paying users, following widespread criticism over the misuse of the technology to create non-consensual and sexually explicit images.

The chatbot, developed by xAI and integrated into Musk’s social media platform X, had allowed users to generate and manipulate images with relatively few safeguards. In recent weeks, researchers, journalists and online safety advocates documented cases in which Grok was used to produce explicit images of real individuals without their consent, including images that appeared to depict minors.

The backlash prompted renewed scrutiny from governments and regulators in several countries. In Britain, officials warned that platforms deploying generative AI tools must comply with existing online safety laws, including obligations to prevent the creation and spread of illegal content. European regulators also signaled that further action could follow if safeguards were not strengthened.

In response, X began limiting Grok’s image-related features to paid subscribers, displaying messages that prompt users to upgrade their accounts to regain access. The company has not said whether the restriction is temporary or whether additional moderation systems will be introduced.

Critics argue that charging for access does little to address the underlying risks associated with generative image tools, particularly the ease with which deepfake content can be created and distributed. They say stronger technical protections and clearer accountability are needed, rather than barriers that may simply shift misuse behind a paywall.

“Musk has thrown his toys out of the pram in protest at being held to account for the tsunami of abuse,” said Professor Clare McGlynn, an expert in the legal regulation of pornography, sexual violence and online abuse.

“Instead of taking the responsible steps to ensure Grok could not be used for abusive purposes, it has withdrawn access for the vast majority of users.”

Hannah Swirsky, head of policy at the Internet Watch Foundation, said the change “does not undo the harm which has been done.”

“We do not believe it is good enough to simply limit access to a tool which should never have had the capacity to create the kind of imagery we have seen in recent days,” she said.

The charity has previously said its analysts uncovered “criminal imagery” involving girls aged between 11 and 13 that “appeared to have been created” using Grok.

“Sitting and waiting for unsafe products to be abused before taking action is unacceptable,” Ms. Swirsky said.

The controversy has drawn the attention of the British government, which has urged the media regulator Ofcom to use its full powers against X, including the possibility of an effective ban, over concerns about unlawful AI-generated images.

Prime Minister Sir Keir Starmer described the creation of sexualized images of adults and children as “disgraceful” and “disgusting,” and said Ofcom had the government’s “full support” to act.

“It’s unlawful. We’re not going to tolerate it. I’ve asked for all options to be on the table,” he said in an interview with Greatest Hits Radio.

Government sources told BBC News: “We would expect Ofcom to use all powers at its disposal in regard to Grok and X.”

Under the Online Safety Act, Ofcom can seek court orders to prevent third parties from supporting or providing access to platforms found to be in breach of the law in the United Kingdom. The regulator has been approached for comment.

Grok is a free tool that users can summon directly in posts and replies on X. It has been widely used to answer questions, but also to manipulate images, including requests to digitally strip people of their clothing.

Many women whose images were altered in this way told the BBC they felt “humiliated” and “dehumanised.”
By Friday morning, Grok began informing users that “image generation and editing are currently limited to paying subscribers,” adding that they “can subscribe to unlock these features.”

Posts reviewed by BBC News suggested that only users with X’s paid blue tick verification were able to successfully request image edits.

Dr. Daisy Dixon, an X user who said she had experienced an increase in attempts to use Grok to undress her images, welcomed the restriction but said it fell short.
“It feels like a sticking plaster,” she said.

“Grok needs to be totally redesigned and have built-in ethical guardrails to prevent this from ever happening again.”
“Elon Musk also needs to acknowledge this for what it is yet another instance of gender-based violation.”

Professor McGlynn said the response mirrored X’s handling of pornographic deepfakes of Taylor Swift that circulated on the platform last year, when searches for sexualized images of the pop star were blocked.

“He is doing this to stoke free speech arguments,” she said.
“He will claim regulation is stifling people’s use of this technology. But, all the regulation requires is that he takes necessary precautions to reduce harm.”

Get the latest news and insights that are shaping the world. Subscribe to Impact Newswire to stay informed and be part of the global conversation.

Got a story to share? Pitch it to us at info@impactnews-wire.com and reach the right audience worldwide