Connect with us

Hi, what are you looking for?

Business

UK regulator opens probe into X over sexualised AI imagery

Grok is facing growing international backlash for allowing users to create and share sexualised pictures of women and children using simple text prompts.
Grok is facing growing international backlash for allowing users to create and share sexualised pictures of women and children using simple text prompts. - Copyright AFP Shammi MEHRA
Grok is facing growing international backlash for allowing users to create and share sexualised pictures of women and children using simple text prompts. - Copyright AFP Shammi MEHRA

UK media regulator Ofcom on Monday launched a formal investigation into Elon Musk’s X over its AI chatbot Grok’s image creation feature that has been used to produce sexualised deepfakes.

Grok is facing growing international backlash for allowing users to create and share sexualised pictures of women and children using simple text prompts.

Ofcom described the reports as “deeply concerning”.

It said in a statement that the undressed images of people “may amount to intimate image abuse or pornography — and sexualised images of children… may amount to child sexual abuse material”.

Contacted by AFP, X did not immediately respond.

Ofcom said it had contacted X on January 5 asking it to explain the steps it has taken to protect UK users. 

Without sharing details of the exchange, the regulator said that X did respond within the given timeframe.

The formal investigation will determine whether X “failed to comply with its legal obligations”.

Under Britain’s Online Safety Act, which came into force in July, websites, social media and video-sharing platforms hosting potentially harmful content are required to implement strict age verification through tools such as facial imagery or credit card checks.

It is also illegal for media sites to create or share non-consensual intimate images or child sexual abuse material, including sexual deepfakes created with AI.

Ofcom has the power to impose fines of 10 percent of worldwide revenue for breaches of these rules.

Grok appeared to deflect the international criticism with a new monetisation policy at the end of last week, posting on X that the tool was now “limited to paying subscribers”, alongside a link to a premium subscription.

UK Prime Minister Keir Starmer has condemned the move as an affront to victims and “not a solution”.

On Saturday, Indonesia became the first country to deny all access to the tool, with Malaysia following suit on Sunday.

The European Commission has said it is reviewing complaints about Grok.

AFP
Written By

With 2,400 staff representing 100 different nationalities, AFP covers the world as a leading global news agency. AFP provides fast, comprehensive and verified coverage of the issues affecting our daily lives.

You may also like:

Tech & Science

How PCL is using AI to standardize complex project data across large industrial construction builds

Tech & Science

A new report contains anonymized information about data movement across hundreds of organizations.

Life

There’s a moment when debt reaches a tipping point. When the pain of worrying about money just has to stop. 

World

Prime Minister Mark Carney launched a multi-billion dollar plan to strengthen the Canadian military and rely less on the US.