X restricts Grok from editing images of real people in revealing clothing

X announced Wednesday that its Grok AI model will no longer be able to edit photos of real people to show them in revealing clothing such as bikinis or underwear.

"We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis," the company stated. "This restriction applies to all users, including paid subscribers."

The restriction was announced hours after California's top prosecutor said the state was investigating the spread of sexualised AI deepfakes, including of children, generated by the AI model. X also reiterated that only paid users will be able to edit images using Grok on its platform.

Elon Musk, CEO of X, said Wednesday he was not aware of any "naked underage images" generated by Grok. "I am not aware of any naked underage images generated by Grok. Literally zero," Musk wrote in an X post.

Musk stated that Grok is programmed to refuse illegal requests and must comply with the laws of any given country or state. "Obviously, Grok does not spontaneously generate images, it does so only according to user requests," he said.

Musk added that Grok will refuse to produce any illegal content, and that "there may be occasions where a prompt injection attack on Grok produces unexpected results. If that happens, we fix the bug immediately."

The restrictions come as xAI and X face growing global scrutiny. Lawmakers and advocacy groups have called for Apple and Google to remove Grok from their app stores. The UK has launched a regulatory investigation into the tool, and countries including Malaysia and Indonesia have implemented bans or legal action against it.

Three Democratic US senators last week called on Apple and Alphabet's Google to remove X and related services from their app stores over concerns about the AI tool.