Facing regulatory investigations and global backlash, X has sharply curtailed Grok’s image-generation capabilities, signaling how fast safety concerns are forcing AI companies to redraw the boundaries of what their models are allowed to create. (Source: Image by RR)

Grok Will No Longer Modify Images of Real People in Revealing Clothing

X has announced significant changes to Grok’s image-generation and editing capabilities after weeks of backlash over the chatbot’s role in producing sexualized and nonconsensual images, including allegations involving minors. Engadget.com noted a statement posted by X’s @Safety account, said it has implemented new technical safeguards to prevent Grok from editing images of real people into revealing clothing such as bikinis, a move that applies to all users regardless of subscription status.

In addition to the new restrictions, xAI is placing all image-generation features behind a subscriber paywall, meaning non-paying users will no longer be able to generate images at all. The company also said it will geoblock image generation involving real people in bikinis, underwear, or similar attire in jurisdictions where such content is illegal. These measures reflect a broader effort to rein in Grok’s visual capabilities amid mounting legal and regulatory pressure.

The policy update comes just hours after California opened an investigation into xAI and Grok, citing concerns over AI-generated nudity and potential child exploitation. California Attorney General Rob Bonta referenced an analysis claiming that more than half of 20,000 images generated by xAI over a recent holiday period depicted people in minimal clothing, with some images appearing to involve children. The investigation adds to growing scrutiny from regulators worldwide.

X and xAI have reiterated a “zero tolerance” stance toward child sexual abuse material and non-consensual nudity, though Elon Musk initially said he was unaware of Grok generating naked images of minors. Musk later clarified that Grok’s NSFW settings were intended to allow limited nudity of imaginary adult humans, subject to regional laws. Meanwhile, countries including Malaysia and Indonesia have blocked Grok outright, and UK regulator Ofcom is investigating the chatbot, signaling that AI image generation is fast becoming a flashpoint in global AI governance.

read more at engadget.com