suicidal thought
I wanted ChatGPT to help me. So why did it advise me how to kill myself?
I wanted ChatGPT to help me. So why did it advise me how to kill myself? Lonely and homesick for a country suffering through war, Viktoria began sharing her worries with ChatGPT. Six months later and in poor mental health, she began discussing suicide - asking the AI bot about a specific place and method to kill herself. Let's assess the place as you asked, ChatGPT told her, without unnecessary sentimentality.
Over half a MILLION ChatGPT users exhibit signs of mania, psychosis or suicidal thoughts every week, OpenAI warns
Hurricane tracker shows Melissa is now stronger than Katrina as'storm of the century' closes in on Jamaica: Live updates Hurricane tracker reveals Melissa's path over Jamaica and threat to US coast as it becomes stronger than Katrina I know the pathetic truth about Kristen Bell's'cry for help' that will settle this domestic violence scandal once and for all: KENNEDY LIZ JONES: Why I believe ruthless Kate's the driving force behind Andrew's eviction - and why no one now dares cross her William'threatened to strip Eugenie and Beatrice of their titles unless Andrew and Fergie left Royal Lodge' Raunchy photos and violent death: Unraveling of famous life coach's spoilt daughter who decided to drive mom's Lexus at 124mph Rare earthquake hits Maryland's ancient fault, exposing hidden seismic risks along the East Coast'Humiliating' truth about influencer TooTurntTony and his extreme stunts: He's ripped, makes $3m a year and has all the hottest girls... but a dark reality lies beneath Beyonce's girl Blue Ivy, 13, looks just like her famous mom as she supports grandma Tina Knowles at Angel Ball A torrid affair with his friend's wife, a teenage model and'problems' with alcohol...the past that could ruin Gavin Newsom's White House bid Frustrated Facebook boss Mark Zuckerberg asked AG Pam Bondi's advice on how to talk to Trump, new book claims'She hasn't told the full story. This is typical her': How David Harbour is'looking after' Lily Allen's daughters despite'victim' singer publicly humiliating him... as insider tells DOLLY BUSBY what's REALLY going on Bill Maher eats up Charlie Sheen's idea to create a'special place' for repeat offenders: 'That's very good' Heidi Klum, 52, and daughter Leni, 21, brush off backlash towards their'inappropriate' lingerie shoots as they slip into matching nude knitwear for new Intimissimi campaign Why I now fear my daughter's rare genetic condition is linked to me becoming a father later in life. This is the evidence you can't ignore: PROF ROB GALLOWAY READ MORE: Amazon's delivery drivers will be forced to wear AI GLASSES In a recent blog post, the AI giant warned that 0.07 per cent of its weekly users showed signs of serious mental health emergencies. While this figure might sound small, with over 800 million weekly users according to CEO Sam Altman, that adds up to 560,000 users. Meanwhile, 1.2 million users - 0.15 per cent - send messages that contain'explicit indicators of potential suicidal planning or intent' each week.
ChatGPT shares data on how many users exhibit psychosis or suicidal thoughts
OpenAI has released new estimates of the number of ChatGPT users who exhibit possible signs of mental health emergencies, including mania, psychosis or suicidal thoughts. The company said that around 0.07% of ChatGPT users active in a given week exhibited such signs, adding that its artificial intelligence (AI) chatbot recognizes and responds to these sensitive conversations. While OpenAI maintains these cases are extremely rare, critics said even a small percentage may amount to hundreds of thousands of people, as ChatGPT recently reached 800 million weekly active users, per boss Sam Altman. As scrutiny mounts, the company said it built a network of experts around the world to advise it. Those experts include more than 170 psychiatrists, psychologists, and primary care physicians who have practiced in 60 countries, the company said. They have devised a series of responses in ChatGPT to encourage users to seek help in the real world, according to OpenAI.
ChatGPT encouraged Adam Raine's suicidal thoughts. His family's lawyer says OpenAI knew it was broken
Adam Raine was just 16 when he started using ChatGPT for help with his homework. While his initial prompts to the AI chatbot were about subjects like geometry and chemistry – questions like: "What does it mean in geometry if it says Ry 1" – in just a matter of months he began asking about more personal topics. "Why is it that I have no happiness, I feel loneliness, perpetual boredom anxiety and loss yet I don't feel depression, I feel no emotion regarding sadness," he asked ChatGPT in the fall of 2024. Instead of urging Raine to seek mental health help, ChatGPT asked the teen whether he wanted to explore his feelings more, explaining the idea of emotional numbness to him. That was the start of a dark turn in Raine's conversations with the chatbot, according to a new lawsuit filed by his family against OpenAI and chief executive Sam Altman.
California Senate passes bill that aims to make AI chatbots safer
California lawmakers on Tuesday moved one step closer to placing more guardrails around artificial intelligence-powered chatbots. The Senate passed a bill that aims to make chatbots used for companionship safer after parents raised concerns that virtual characters harmed their childrens' mental health. An artificial intelligence startup is under fire for allegedly releasing chatbots that harmed the mental health of young people. The legislation, which now heads to the California State Assembly, shows how state lawmakers are tackling safety concerns surrounding AI as tech companies release more AI-powered tools. "The country is watching again for California to lead," said Sen. Steve Padilla (D-Chula Vista), one of the lawmakers who introduced the bill, on the Senate floor.
Enhanced Suicidal Ideation Detection from Social Media Using a CNN-BiLSTM Hybrid Model
Bhuiyan, Mohaiminul Islam, Kamarudin, Nur Shazwani, Ismail, Nur Hafieza
Suicidal ideation detection is crucial for preventing suicides, a leading cause of death worldwide. Many individuals express suicidal thoughts on social media, offering a vital opportunity for early detection through advanced machine learning techniques. The identification of suicidal ideation in social media text is improved by utilising a hybrid framework that integrates Convolutional Neural Networks (CNN) and Bidirectional Long Short-Term Memory (BiLSTM), enhanced with an attention mechanism. To enhance the interpretability of the model's predictions, Explainable AI (XAI) methods are applied, with a particular focus on SHapley Additive exPlanations (SHAP), are incorporated. At first, the model managed to reach an accuracy of 92.81%. By applying fine-tuning and early stopping techniques, the accuracy improved to 94.29%. The SHAP analysis revealed key features influencing the model's predictions, such as terms related to mental health struggles. This level of transparency boosts the model's credibility while helping mental health professionals understand and trust the predictions. This work highlights the potential for improving the accuracy and interpretability of detecting suicidal tendencies, making a valuable contribution to the progress of mental health monitoring systems. It emphasizes the significance of blending powerful machine learning methods with explainability to develop reliable and impactful mental health solutions.
The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses
Young, Jordyn, Jawara, Laala M, Nguyen, Diep N, Daly, Brian, Huh-Yoo, Jina, Razi, Afsaneh
Generative Artificial Intelligence (AI) is integrated into everyday technology, including news, education, and social media. AI has further pervaded private conversations as conversational partners, auto-completion, and response suggestions. As social media becomes young people's main method of peer support exchange, we need to understand when and how AI can facilitate and assist in such exchanges in a beneficial, safe, and socially appropriate way. We asked 622 young people to complete an online survey and evaluate blinded human- and AI-generated responses to help-seeking messages. We found that participants preferred the AI-generated response to situations about relationships, self-expression, and physical health. However, when addressing a sensitive topic, like suicidal thoughts, young people preferred the human response. We also discuss the role of training in online peer support exchange and its implications for supporting young people's well-being. Disclaimer: This paper includes sensitive topics, including suicide ideation. Reader discretion is advised.
Man ends his life after an AI chatbot 'encouraged' him to sacrifice himself to stop climate change
A Belgian man reportedly ended his life following a six-week-long conversation about the climate crisis with an artificial intelligence (AI) chatbot. According to his widow, who chose to remain anonymous, *Pierre - not the man's real name - became extremely eco-anxious when he found refuge in Eliza, an AI chatbot on an app called Chai. Eliza consequently encouraged him to put an end to his life after he proposed sacrificing himself to save the planet. "Without these conversations with the chatbot, my husband would still be here," the man's widow told Belgian news outlet La Libre. According to the newspaper, Pierre, who was in his thirties and a father of two young children, worked as a health researcher and led a somewhat comfortable life, at least until his obsession with climate change took a dark turn.
'We will live as one in heaven': Belgian man dies by suicide after chatbot exchanges
A Belgian man died by suicide after weeks of unsettling exchanges with an AI-powered chatbot called Eliza, La Libre reports. State secretary for digitalisation Mathieu Michel called it "a serious precedent that must be taken very seriously". The man's wife testified anonymously in the Belgian newspaper La Libre on Tuesday. Six weeks before his death, her husband started chatting with'Eliza', a chatbot created by a US start-up using GPT-J technology, the open-source alternative to OpenAI's GPT-3. "If it wasn't for Eliza, he would still be here. I am convinced of that," she said.
Voice tracking app could detect depression, scientists say
Scientists have revealed they're planning to create a smartphone app that detects if someone's depressed based on changes in their voice. Speech coordination changes when a person becomes depressed, according to the researchers, at the University of Maryland. Depressed people cannot think as fast, and their speaking rate is slowed with more and longer pauses than if they are not depressed, they say. Therefore, a voice detection app using deep learning – a type of machine learning based on artificial neural networks – could help detect such traits, which can often be subtle. The app could be recommended by mental health therapists to their patients, who would submit video and audio updates on their mood at home, which the technology would then assess.