Ask Onix
Southeast Asia blocks Grok over explicit deepfake concerns
Malaysia and Indonesia have become the first countries to restrict access to Elon Musk's AI chatbot Grok after reports surfaced of users generating sexually explicit deepfakes of real people, including women and children.
Government actions and demands
Both nations announced the ban over the weekend, citing repeated misuse of the tool to create harmful content. Malaysia's Communications and Multimedia Commission revealed it had issued prior warnings to X (formerly Twitter) earlier this year, urging stricter controls. However, the regulator stated that X's response focused primarily on user reporting mechanisms rather than addressing the platform's design flaws.
"Grok will remain blocked until effective safeguards are put in place," the commission said, encouraging the public to report any harmful online material.
Indonesia's stance on digital safety
Indonesia's Ministry of Communications and Digital Affairs condemned the use of Grok to produce explicit content as a violation of human rights and online safety. Minister Meutya Hafid, in an Instagram post, demanded that X clarify its policies regarding Grok's usage.
The country has a history of cracking down on pornographic content, with platforms like OnlyFans and Pornhub already banned. Despite these efforts, Indonesian users reported discovering manipulated images of themselves on X, often without consent.
Impact on users and platform response
Kirana Ayuningtyas, a wheelchair user who documents her daily life online, discovered a stranger had used Grok to generate a bikini-clad image of her. Despite adjusting her privacy settings and requesting removal, she found the process ineffective.
"It's hard to know if someone still has those images. Reporting the accounts only means more people see them, which is humiliating."
Kirana Ayuningtyas, social media user
The BBC has reached out to Grok for comment but has not yet received a response.
Global backlash and UK pressure
Criticism of Grok's misuse has extended beyond Southeast Asia. UK Prime Minister Keir Starmer labeled the creation of sexualized deepfakes "disgraceful" and "disgusting." Technology Secretary Liz Kendall signaled support for regulator Ofcom if it moves to block X in the UK for non-compliance with online safety laws.
Under the UK's Online Safety Act, authorities have the power to restrict access to platforms that fail to adhere to local regulations. Kendall emphasized that Ofcom would receive "full support" if it chooses to enforce such measures.
What's next
Both Malaysia and Indonesia have called for immediate action from X to implement stronger safeguards. Meanwhile, global scrutiny of AI-generated content continues to intensify, with governments weighing the balance between innovation and user protection.
