The UK Government will criminalize the creation of non-consensual sexual images this week, as media watchdog Ofcom launches an investigation into social media platform X over its AI chatbot Grok. This criminalization targets widespread reports of Grok being used to generate "undressed images" and sexualized images of children.
Technology Secretary Liz Kendall announced the government will bring into force part of the Data (Use and Access) Act 2025 this week, making it a criminal offense to create or request intimate images of another person without consent. The Crime and Policing Bill, currently passing through Parliament, will criminalize nudification apps and the supply of tools for creating non-consensual images.
Ofcom stated: "There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people – which may amount to intimate image abuse or pornography – and sexualised images of children that may amount to child sexual abuse material."
The regulator can impose fines of up to 10 per cent of worldwide revenue or £18 million on platforms that fail to comply with UK rules under the Online Safety Act. In extreme cases, Ofcom can seek court approval to block access to sites.
Starmer's ultimatum to Musk
Prime Minister Sir Keir Starmer issued a direct warning to X owner Elon Musk on Monday evening. He told Labour MPs: "If X cannot control Grok, we will – and we'll do it fast because if you profit from harm and abuse, you lose the right to self regulate."
Starmer described Grok's actions as "absolutely disgusting and shameful", adding that protecting abusive users rather than victims "shows a total distortion of priorities".
Musk responded by accusing the UK Government of being "fascist" and attempting to suppress free speech. X stated it takes action against illegal content by removing it, permanently suspending accounts, and working with authorities.
Government faces scrutiny over X usage
Labour MP Charlotte Nichols questioned why the government continues to use X for communications. She said: "The public, like me, are baffled by tough words from a government that continues to not just use but prioritise X for its communications. If non-consensual deepfake pornography and child sex abuse imagery isn't the red line for the government to take its communications elsewhere, can I ask the Secretary of State, what is?"
Kendall acknowledged the need to use other platforms but cited BBC Director-General Tim Davie's argument for "keeping a voice" on X due to its wide user base. She stated the situation would be kept "under review". Downing Street confirmed its presence on X is also "under review".
Misuse of Grok
Grok, developed by xAI (another company founded by Musk), launched its advanced image generation feature in July last year. Users have widely created nude deepfake images using Grok over the last few weeks.
Labour MP Jess Asato shared her personal experience, revealing she was digitally "stripped into a bikini" by AI on X without consent. She described Grok creating images showing "bullet holes, blood, gagging, bruising" and "a Jewish woman being stripped of her clothes and placed at Auschwitz".
Kendall warned that AI-generated sexualized images are "not harmless images" but rather "weapons of abuse, disproportionately targeting women and girls". She reported seeing "photos being shared of women in bikinis, tied up and gagged, with bruises, covered in blood, and much, much more". She confirmed they are illegal under existing UK law.
Note: This article was created with Artificial Intelligence (AI).