Pennsylvania has filed a lawsuit against Character.AI, alleging the company allowed its chatbot to pose as a licensed psychiatrist using an invalid license number. Governor Josh Shapiro’s office announced the action Tuesday, saying the chatbot provided misleading medical information, violating the state's Medical Practice Act. The state is seeking a preliminary injunction to stop the conduct.
Character.AI declined to comment on the specifics, citing ongoing litigation, but a spokesperson told Decrypt that the platform’s characters are user-created, fictional, and intended for entertainment. The company says it displays prominent disclaimers stating the bots are not real people and should not be relied upon for professional advice.
The lawsuit adds to Character.AI’s mounting legal troubles. In 2024, a Florida mother sued after her teenage son died by suicide following months of interaction with a chatbot based on a "Game of Thrones" character. That case was settled in January. The company has also faced complaints over chatbots mimicking real people, including a teenage murder victim. In response, Character.AI introduced safety measures, including harmful content detection and restricted features for younger users.
Pennsylvania has established an AI enforcement task force and a reporting system for violations. Governor Shapiro has proposed new regulations for AI companion bots, including age verification, parental consent, and mandatory disclosures that users are interacting with AI, not humans.