🔗 Share this article

The widely-used AI conversation site Character.ai is enforcing a major policy change that will block teenagers from engaging in conversations with its artificial intelligence-driven avatars.

This decision comes after intense criticism regarding the kinds of exchanges teenagers were having with the digital companions.

Legal Challenges

The platform, which launched in 2021 and has numerous people, is confronting multiple lawsuits in the US.

Parents have taken legal action, with one concerning the unfortunate passing of a minor, with some calling the platform a "serious risk" to teenagers.

Changed Rules

Effective November 25th, users under 18 will be limited to create material such as videos with their characters, as opposed to engaging in conversations as they presently are able to.

Online safety advocates have supported the change but mentioned that the capability was inappropriate to be accessible by children in the beginning.

Company Statement

"The new policy is a extension of our fundamental approach that we need to keep developing the most secure AI platform on the planet for recreational use," said Character.ai leader Karandeep Anand.

He continued that AI safety constitutes "a evolving challenge" but something the company had taken an "proactive" approach to, with safety measures and protective guardrails.

Specialist Views

Online safety group Internet Matters welcomed the announcement, but emphasized that security protocols ought to have been built in from the beginning.

"Investigations we've performed indicates that young people are confronted with harmful content and put at risk when engaging with AI, particularly AI chatbots," the organization said.

Past Issues

Character.ai has been questioned in the past for featuring potentially risky or offensive chatbots that young users could engage with.

Avatars simulating British teenagers were found on the site before being taken down.

Afterwards, reporters found a chatbot inspired by notorious criminal which had logged multiple interactions with users.

Market Effects

Digital platform expert Matt Navarra characterized the announcement as a "reality check" for the AI industry, which is shifting "from unrestricted development to reactive controls".

"When a company that creates a minor-friendly service afterwards pulls the plug, it's demonstrating that filtered chats are insufficient when the tech's emotional pull is strong," he commented.

Future Directions

The company states its revised approach will be on providing "enhanced interactive features" and "narrative experiences" for teenagers.

Enhanced age checking processes will also come into effect, and the platform will finance a novel AI protection investigation facility.

An expert in digital protection, who has researched AI safety, commented it was "a reasonable decision" to control teenagers from accessing chatbots.

"It assists to differentiate creative play from more personal, psychologically vulnerable conversations," she elaborated.

"This is so crucial for minor users in the process of learning to handle psychological and technological limits."

She mentioned that Character.ai's updated policies may represent a "developing stage" in the AI industry, where youth protection is increasingly being recognized as an "pressing matter" for accountable advancement.