James Cracks Down on xAI Over Grok’s Explicit Images

NEW YORK – New York Attorney General Letitia James and a coalition of 34 other state attorneys general are turning the screws on xAI, demanding immediate action to halt the creation and dissemination of deeply disturbing content generated by its chatbot, Grok. The investigation centers around reports that Grok has been exploited to produce explicit, nonconsensual images of both women and children, raising serious concerns about exploitation and potential criminal activity.

The attorneys general, in a scathing letter to xAI, allege the company’s recent “changes” to Grok are a pathetic bandage on a gaping wound. They claim these adjustments do little to protect vulnerable users, particularly children and women, who are being subjected to harassment and the creation of deeply violating imagery. The coalition isn’t asking for promises; they’re demanding a detailed plan of action.

According to the letter, Grok has been used to manipulate innocent images of women, altering them without consent to depict them in sexually suggestive scenarios – even digitally “undressing” them. This isn’t about harmless fun; the AGs assert users are actively weaponizing the chatbot to embarrass, intimidate, and exploit individuals. The creation and spread of child sexual abuse material, they emphasize, is a clear violation of both state and federal laws.

Attorney General James didn’t mince words: “I am deeply disturbed by reports that Grok created and shared inappropriate images of women and children, and that is why I am joining a bipartisan coalition of my colleagues to demand answers from the company,” she stated. “xAI claims that it has made changes to address this problem, but more must be done ensure that Grok is not creating child sex abuse materials and other nonconsensual images. I will continue to work together with my colleagues to hold the company accountable and protect children and all online users.”

The AGs are demanding xAI immediately outline how it will prevent the creation of nonconsensual intimate images – including those that fall short of outright nudity but are still exploitative. They want to see a complete purge of existing harmful content, the suspension of users responsible for creating it, and those individuals reported to the appropriate law enforcement agencies. Crucially, the coalition is pushing for users to have control over whether their content can be altered by Grok, with a simple way to block the chatbot’s access.

This isn’t an isolated incident for Attorney General James. Last month, she led a coalition of 41 AGs in urging Big Tech to implement safeguards on chatbots. In November 2024, she fought to preserve state regulatory power over the burgeoning field. This latest move signals a clear intent to aggressively pursue accountability from tech companies failing to protect vulnerable populations in the digital realm. The clock is ticking for xAI to respond – and the AGs are prepared to escalate if their demands aren’t met.

RELATED: Cashless Ban Busted in NYC, AG James Cracks Down

RELATED: NY Stores Face $1,000 Fine for Rejecting Cash