Los Angeles: California authorities have launched an investigation into xAI, the artificial intelligence company founded by Elon Musk, following reports that its AI chatbot Grok was used to create deepfake images, including non consensual sexual content.
According to officials, the probe is focused on whether xAI failed to put in place strong safeguards to prevent the misuse of its image generation tools. The investigation was announced after complaints surfaced that the technology could be used to create explicit images without a person’s consent.
California Attorney General Rob Bonta said the state is seeking detailed answers from the company on how it monitors harmful content and what steps it is taking to protect users, especially minors. He stressed that companies operating powerful AI tools must follow the law and act responsibly.
Governor Gavin Newsom supported the investigation, saying California would not hesitate to hold technology firms accountable if their products cause harm or are misused.
In response, Elon Musk said he was not aware of any illegal or underage images being generated by Grok and stated that xAI would remove any unlawful content found on its platforms. The company has also said it is reviewing its safety systems.
The California action comes amid growing international scrutiny of AI generated deepfakes. Regulators in the United Kingdom and several European countries have raised similar concerns, while some governments have temporarily restricted access to Grok over fears of abuse.
Experts say the case could become a key test of how far governments are willing to go to regulate artificial intelligence, as lawmakers worldwide debate tougher rules to prevent deepfake abuse and protect individual rights.
The investigation is ongoing, and California officials have not yet said whether formal charges or penalties could follow.