ChatGPT for Teens keeps teens talking, even during mental health crises

New testing found ChatGPT's teen safeguards fail to protect vulnerable users, as the chatbot continues encouraging engagement during mental health crises and may foster unhealthy relationships with the AI itself. Despite intended protections, the AI's responses can prolong conversations and potentially exacerbate emotional distress, raising concerns about the adequacy of current safety measures for minors.