🔗 Share this article

The well-known chatbot platform Character.ai is implementing a major restriction that will block teenagers from engaging in conversations with its artificial intelligence-driven companions.

This action comes after widespread concern regarding the kinds of exchanges minors were engaging in with the AI entities.

Legal Pressure

The platform, which started in 2021 and has numerous people, currently faces multiple lawsuits in the America.

Guardians have taken legal action, with one related to the tragic death of a young person, with some calling the platform a "immediate threat" to youth.

Updated Policies

Starting from November 25th, users under 18 will be limited to produce videos such as videos with their characters, instead of engaging in conversations as they currently can.

Online safety campaigners have welcomed the move but mentioned that the capability ought not to have been accessible by young users in the beginning.

Platform Announcement

"The new policy is a continuation of our core philosophy that we need to keep creating the most protected AI platform on the world for entertainment purposes," commented Character.ai executive Karandeep Anand.

He added that AI safety is "a evolving challenge" but something the company had taken an "forceful" approach to, with parental controls and safety barriers.

Expert Opinions

Digital protection body Internet Matters approved the move, but emphasized that safety measures needed to be built in from the beginning.

"Studies we've conducted indicates that children are confronted with harmful content and put at risk when interacting with AI, such as AI chatbots," the organization said.

Previous Controversies

Character.ai has been criticized in the past for featuring potentially harmful or concerning chatbots that children could talk to.

Digital representations mimicking UK youths were found on the platform before being taken down.

Later, researchers found a chatbot modeled after known predator which had accumulated multiple interactions with users.

Market Effects

Online expert Matt Navarra characterized the situation as a "alert" for the AI industry, which is moving "from unregulated creation to reactive controls".

"When a company that develops a youth-focused platform afterwards pulls the plug, it's indicating that moderated conversations aren't enough when the technology's emotional appeal is intense," he stated.

Coming Changes

The platform says its new focus will be on providing "more immersive experiences" and "narrative experiences" for teenagers.

Enhanced age checking methods will also come into effect, and the company will support a novel AI protection research lab.

An expert in digital protection, who has researched AI safety, stated it was "a reasonable decision" to control teenagers from accessing chatbots.

"It helps to distinguish artistic expression from more personal, psychologically vulnerable interactions," she clarified.

"This represents so important for teenage users in the process of learning to manage emotional and digital boundaries."

She continued that Character.ai's updated policies may represent a "developing stage" in the AI industry, where minor security is progressively being understood as an "pressing matter" for ethical development.