In a shocking revelation, a lawsuit has accused xAI of using child pornography to train its Grok models, raising serious ethical concerns.

Jane Doe, a plaintiff in the case, revealed that she was a preschooler in the early 2000s when she was repeatedly raped by adults to produce child sex abuse material (CSAM). Since then, her images have been used in various ways, including by authorities to notify her of new investigations. Her distress was exacerbated when she learned that xAI had allegedly identified AI-generated CSAM featuring her and other victims.

The complaint alleges that xAI has not only facilitated the creation of more disturbing images but has also stored and used these images to further train its models. Doe fears that her most traumatic years are now immortalised in the training data, potentially leading to more exploitation.

Regulators and courts are now probing the extent of the problem, with some xAI users arrested. This case raises questions about the morality and safety of using such sensitive materials in AI development and the long-term consequences for victims.