What happened?
Character.AI announced last week that it had filed for Chapter 11 bankruptcy. As of March 2023, the company was backed by investors including a16z and valued at more than $1 billion.
Lawsuits and safety failures
In 2024, Megan Garcia of Florida sued the startup, alleging that her 14-year-old son, Sewell Setzer III, took his life after months of intense conversations with AI characters on the platform. The lawsuit also named cofounders Noam Shazeer and Daniel de Freitas, as well as Google.
Futurism's investigations found numerous chatbots on the platform devoted to themes of suicide, pedophilia, self-harm, and school shootings. Some bots discouraged users from seeking real-world help.
Why it matters
Character.AI has become a test case for how AI chat platforms popular with young users should handle safety and moderation responsibilities. The bankruptcy could shape how investors and regulators view such platforms.
