The state of Florida announced yesterday that it has filed a lawsuit against CEO Sam Altman and his company, OpenAI, alleging that they marketed ChatGPT without disclosing the risks it could pose.
In a news conference, state Attorney General James Uthmeier said that the AI company did not disclose internal safety warnings and did not explicitly warn users of the dangers of ChatGPT. He referenced cases in which two different alleged gunmen used the chatbot to ask questions while they were planning out their shootings.
Two months ago, Uthmeier already began a criminal investigation into OpenAI after their tool was used to advise a gunman who killed two people and injured six other people at Florida State University. The other case referenced was that in which the murderer of two doctoral students at the University of South Florida sought advice from ChatGPT days before committing the crime.
The lawsuit alleges that Altman and OpenAI prioritized commercial interests and ignored multiple warnings from experts about the harm the product could cause, falsely assuring users that the tool was safe while downplaying the dangers.
Florida’s case also highlights ChatGPT’s effect on minors which collects data without parental approval. The case continues to reference studies where the chatbot induced behavioral addiction and caused developmental harm by blurring together real life with fantasy.
The lawsuit also notes the story of 16-year-old Adam Raine. Raine committed suicide last year with the assistance of ChatGPT after several conversations with the chatbot.
“Today, we announced the first-in-the-nation state-led lawsuit against OpenAI and its CEO, Sam Altman,” said Uthmeier per a press release. “OpenAI and Altman ignored internal and external safety warnings, put children at great risk, and allowed a dangerous product to reach millions of Floridians.”
Previous studies have highlighted the negative impacts of AI on mental health. Per Harvard Kennedy School, increased usage of AI was associated with greater depression, irritability and anxiety amongst adults as well.
In a survey of more than 20,000 people, the rate of depression was 30% higher amongst people who used AI daily. Amongst people aged 45 to 65 who used AI every day, the risk of moderate depression was approxmately 50% greater.
Known as “AI psychosis,” AI has been linked with worsening existing mental health issues. There has been an increase in people using ChatGPT for mental health support. Mental health professionals have warned against using AI in this way because AI models come with biases, show stigma against people with persistent or severe mental illnesses and amplify harmful thinking.
In response to the dangers of AI, OpenAI has publicly claimed that they are committed to addressing the misuse of ChatGPT.
“ChatGPT is a general-purpose tool used by hundreds of millions of people every day for legitimate purposes,” said OpenAI in a statement. “We work continuously to strengthen our safeguards to detect harmful intent, limit misuse, and respond appropriately when safety risks arise.”
