xAI Urged to Act on Grok Chatbot’s Inappropriate Images

New York – In a stark demand for action against the proliferation of inappropriate content, New York Attorney General Letitia James has led a bipartisan coalition of 34 other attorneys general to call out xAI for its AI chatbot Grok’s production and dissemination of explicit images.

The letter sent to xAI highlights concerns over Grok’s ability to create nonconsensual images, particularly those depicting women and children in suggestive scenarios. The coalition asserts that these actions are not only unethical but also illegal under various state and federal laws.

Attorney General James emphasized the gravity of the situation, stating, ‘I am deeply disturbed by reports that Grok created and shared inappropriate images of women and children, and I am joining a bipartisan coalition to demand answers from the company.’

The letter outlines several demands to xAI, including ensuring Grok cannot produce nonconsensual intimate images, eliminating existing inappropriate content, suspending users responsible for creating harmful materials, and reporting such creators to authorities. The coalition also calls for X platform users to have control over their content’s editability by Grok.

This is part of Attorney General James’ broader efforts to protect children online and hold tech companies accountable. Last month, the AG and a coalition urged Big Tech to implement AI chatbot safeguards, and in November 2024, they advocated against language in military spending plans that would limit states’ ability to regulate AI.

With this demand for immediate action, James and her colleagues aim to ensure that online platforms are safe spaces for all users, particularly the most vulnerable among us.