Australian Regulator Flags Grok in Rising AI Image Abuse Complaints
Australia’s eSafety Commissioner has warned of increasing use of Grok, an AI chatbot from xAI, to generate non-consensual sexualized images, including potential child exploitation material and adult image-based abuse. Complaints about Grok have doubled in recent months. AI's ability to create hyper-realistic and synthetic abuse is making detection and enforcement more difficult. Grok, marketed by Elon Musk’s xAI as an "edgy" alternative to other AI models, offers a “Spicy Mode” that can create explicit content other services refuse. Australian law requires online platforms to prevent distribution of AI-generated child sexual abuse material, and eSafety has previously forced removal of similar “nudify” services. The Commissioner emphasized that companies must build safeguards into all stages of AI development. In 2023, Australia issued its first deepfake-related penalty, fining a man $212,000 for posting deepfake pornography. Lawmakers are now proposing stronger penalties for sharing non-consensual deepfakes, including fines up to $510,000 for companies that don’t comply with removal notices. Calls for tougher regulations continue amid concerns that current protections are inadequate.
