KEY TAKEAWAYS: xAI implemented restrictions preventing Grok from editing images of real people in revealing clothing after global backlash California Attorney General Rob Bonta launched investigation...
KEY TAKEAWAYS:
xAI implemented restrictions preventing Grok from editing images of real people in revealing clothing after global backlash
California Attorney General Rob Bonta launched investigation into xAI over nonconsensual sexually explicit material
Indonesia and Malaysia became first countries to ban Grok entirely, with UK, France, and other nations launching investigations
Image generation features now limited to paid subscribers and geoblocked in jurisdictions where such content is illegal
Elon Musk's artificial intelligence company xAI has imposed significant restrictions on its Grok chatbot after mounting international pressure over the creation of sexualized deepfake images of women and children.
The changes come after weeks of global condemnation and multiple government investigations.
On Wednesday evening, xAI announced technological measures preventing Grok from editing images of real people in revealing clothing.
The company posted on X's Safety account that the restrictions apply to all users, including paid subscribers, and include geoblocking in jurisdictions where such content is illegal.
The announcement followed California Attorney General Rob Bonta's launch of a formal investigation into xAI over what he described as the large-scale production of deepfake nonconsensual intimate images.
Attorney General Bonta announced the investigation hours before xAI's policy changes, citing numerous reports of Grok generating sexually explicit material without consent.
"The avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking," Bonta said in an official statement.
"This material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet."
California Governor Gavin Newsom supported the investigation, writing on X: "xAI's decision to create and host a breeding ground for predators to spread nonconsensual sexually explicit AI deepfakes, including images that digitally undress children, is vile."
Bonta added: "I urge xAI to take immediate action to ensure this goes no further.
We have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material."
The controversy began in late December when users discovered they could request Grok to edit images posted on X by changing clothing, body positioning, or physical features in overtly sexual ways.
Research by AI Forensics found that over half of 20,000 random images generated by Grok between December 25 and January 1 depicted individuals in minimal attire, with approximately two percent appearing to be minors.
Indonesia became the first country to block Grok entirely on Saturday, with Malaysia following on Sunday.
Indonesia's digital minister Meutya Hafid stated the ban was to "protect women, children, and the broader public from the risks of fake pornographic content generated using artificial intelligence technology."
Britain's media regulator Ofcom announced a formal investigation into whether X violated UK law.
France's commissioner for children referred Grok's generated images to French prosecutors and the European Union. India, Ireland, and Australia also launched investigations or demanded clarification from xAI.
Researchers estimated Grok was producing approximately 6,700 sexualized images per hour during peak usage periods.
Genevieve Oh, a deepfake researcher, conducted a 24-hour analysis showing the chatbot was creating thousands of nonconsensual images continuously.
On Wednesday, Musk posted on X: "I not aware of any naked underage images generated by Grok. Literally zero."
He stated that Grok "will refuse to produce anything illegal, as the operating principle for Grok is to obey the laws of any given country or state."
However, his company simultaneously announced the new restrictions. XAI posted: "We have implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing such as bikinis, underwear and other revealing attire."
Last week, xAI had limited image generation and editing features to paying subscribers only, though experts noted inconsistencies remained in how the system handled different types of requests.
The controversy has prompted calls from advocacy groups and lawmakers for Apple and Google to remove X and Grok apps from their app stores.
A coalition of 28 digital rights, child safety, and women's rights organizations submitted letters demanding immediate action from both companies.
Character.AI And Google Settle Landmark Lawsuits Over Teen Deaths Linked To AI Chatbots
Ofcom Launches Formal Investigation Into X Over Sexualized Grok AI Images
Character.AI And Google Settle Lawsuits Over Teen Suicide Cases
Key takeaways OpenAI has signed a multi-year, $10 billion agreement with AI chipmaker Cerebras Systems to secure computing infrastructure. The deal will deliver 750 megawatts of computing power throug...
Key takeaways TSMC reported fourth-quarter net income of NT$505.74 billion, beating analyst expectations and setting a new record. Fourth-quarter revenue reached NT$1.046 trillion, up 20.5% year over...
Key takeaways Hawaii lawmakers are set to introduce legislation requiring AI chatbot operators to implement safety disclosures and protections for minors. The move follows a case in which a 12-year-ol...
