Indonesia Bans Grok After AI Generates Sexual Deepfakes Involving Children

On Saturday, Indonesian authorities blocked the use of the chatbot Grok, an AI developed by Elon Musk’s firm, xAI. The main reason for banning the use of this AI program is the production of sexual content in the form of deepfake images by the AI. It’s worth noting that through this banning act, Indonesia has made history as the first nation in the global world that has banned the use of the AI program entirely for reasons of security. The communications minister of the Indonesian government, Meutya Hafid, made a statement regarding the matter of sexual deepfakes.

There have been concerns about Grok not only in Indonesia but also in other parts of the world from Europe to Asia. Regulators in some countries have even launched investigations into the app's sexually explicit and sensitive content. Amidst these concerns, Indonesia has become the first country to take the most drastic step, directly blocking access. Indonesia, home to the world's largest Muslim population, has very strict laws regarding pornography on the internet.

xAI recently acknowledged that security flaws in Grok resulted in outputs containing sexually explicit and objectionable content involving children. Following this, the company decided to limit the image generation and editing feature to paid users only.