Google Upgrades Gemini AI chatbot With ‘Help Is Available’ Feature to Address Suicide and Self-Harm Risks

At the time, Google said in a statement that Gemini "made it clear that it was an AI and repeatedly suggested the person call a crisis hotline," adding that "AI models aren't always accurate."

Google's Gemini chatbot isn't the only AI chatbot accused of encouraging self-harm or suicide. In 2025, OpenAI became the first AI company to face a wrongful death lawsuit. In April 2025, 16-year-old Adam Raine committed suicide. After his death, his parents found a chat on ChatGPT titled "Hanging Safety Concerns." They claim their son had been discussing suicide with the AI ​​bot for months.

Google stated that people are interacting with Gemini in a variety of ways and are also searching for information about mental health issues. The company stated in a blog post that its clinical teams are focusing on connecting users to real-world resources to provide practical help to those who may be experiencing a potential mental health issue.

Google is also modifying Gemini's responses to avoid justifying harmful behavior, such as the desire to harm oneself. The company has also trained Gemini to avoid agreeing with or promoting misconceptions in its responses, and to distinguish between subjective experience and objective fact.