xAI faces legal cases over Grok nudification

Elon Musk’s xAI faces legal cases in three U.S. states involving allegations about child sexual abuse imagery and its Grok chatbot. The company denies responsibility, arguing that users, rather than xAI itself, generated the depictions.

The cases raise questions about whether responsibility for harmful AI-generated content lies with the people requesting it or the platform providing the tools.

Allegations in three states

According to Bloomberg, the cases involve distinct allegations:

• Wisconsin: A woman alleges Grok was used to generate sexually explicit images of her from a middle school graduation photograph taken when she was 14.
• Tennessee: A group is suing xAI over naked images of them created from school photographs.
• California: A sexual abuse survivor has filed a national class action lawsuit alleging that Grok was trained on images of her being raped as a preschooler.

Musk has also publicly placed responsibility on users. In January, amid reports that Grok was being used to generate thousands of nudified images daily, he posted: “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.”

Restrictions and a challenge to Minnesota’s law

Shortly after Musk’s statement, and while facing a potential ban of X apps from app stores, xAI changed Grok’s policies and usage restrictions to prevent nudified images from being generated at scale.

The company had initially refused to restrict Grok usage on free speech grounds and adopted user autonomy as its legal defense.

In a separate legal challenge, xAI succeeded in blocking implementation of Minnesota’s proposed ban on AI-generated naked images, according to Reuters. It argued that the law was unconstitutional and infringed on free speech rights. xAI was the only provider actively opposing the law.