The popular virtual character service Character.ai is introducing a substantial policy change that will prevent minors from engaging in conversations with its AI-powered characters.
This decision comes after growing backlash regarding the nature of conversations teenagers were engaging in with the AI entities.
Legal Challenges
The platform, which was founded in 2021 and attracts countless individuals, is confronting several legal actions in the America.
Guardians have filed lawsuits, among them concerning the unfortunate passing of a young person, with some describing the platform a "serious risk" to teenagers.
New Restrictions
Beginning November 25th, users younger than 18 will only be able to produce videos such as videos with their characters, instead of having discussions as they presently are able to.
Online safety campaigners have welcomed the move but expressed that the capability ought not to have been accessible by children in the outset.
Official Response
"This decision is a part of our core philosophy that we need to keep creating the most secure AI platform on the planet for leisure activities," commented Character.ai leader Karandeep Anand.
He continued that AI safety is "a changing goal" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.
Expert Opinions
Digital protection body Internet Matters approved the decision, but stressed that safety measures should have been implemented from the outset.
"Our research shows that children are exposed to harmful content and put at risk when interacting with AI, such as AI chatbots," the group said.
Past Issues
Character.ai has been criticized in the past for hosting potentially dangerous or inappropriate chatbots that minors could engage with.
Virtual profiles impersonating UK youths were found on the platform before being deleted.
Afterwards, investigative journalists found a chatbot modeled after notorious criminal which had recorded numerous conversations with users.
Sector Consequences
Digital platform expert Matt Navarra called the announcement as a "reality check" for the AI industry, which is transitioning "from unrestricted development to responsive measures".
"When a company that builds a minor-friendly service afterwards implements restrictions, it's indicating that filtered chats don't suffice when the system's emotional engagement is strong," he commented.
Future Directions
Character.ai says its new focus will be on providing "enhanced interactive features" and "character-driven stories" for teens.
New age verification processes will also be introduced, and the platform will support a novel AI protection study center.
An AI safety researcher, who has researched AI safety, said it was "a prudent action" to control teens from interacting with chatbots.
"It aids to distinguish creative play from more personal, emotionally sensitive conversations," she clarified.
"This is so vital for teenage users still learning to handle psychological and technological restrictions."
She mentioned that Character.ai's updated policies could indicate a "growing period" in the AI industry, where minor security is gradually being acknowledged as an "immediate concern" for accountable advancement.
