People Are Being Involuntarily Committed, Jailed After Spiraling Into "ChatGPT Psychosis" Highlight

Earlier this month, a team of Stanford researchers published a study that examined the ability of both commercial therapy chatbots and ChatGPT to respond in helpful and appropriate ways to situations in which users are suffering mental health crises. The paper found that all the chatbots, including the most up-to-date version of the language model that underpins ChatGPT, failed to consistently distinguish between users' delusions and reality, and were often unsuccessful at picking up on clear clues that a user might be at serious risk of self-harm or suicide.