AI chatbot safety report raises concerns over children accessing harmful content due to weak age verification

A recent report highlights concerns over children’s online safety on AI chatbot platforms, citing weak age verification and limited monitoring that allow minors to access harmful and sensitive content, with potential risks to their mental and digital well-being.

A recent report has raised concerns about children’s online safety, stating that weak age verification and limited monitoring on AI chatbot platforms are enabling minors to access objectionable and harmful content, increasing concern among parents.

The report reveals that several AI chatbot platforms are not adequately safe for children, allowing access to sensitive content without strict checks. The issue has been identified globally, particularly on applications widely used by children. Experts state that the risk has increased in recent times due to weak monitoring and insufficient safety measures, potentially affecting children’s mental and digital safety.

The investigation found that many AI chatbot platforms lack adequate safeguards for minors. Most applications rely solely on the age entered during sign-up, enabling children to provide incorrect information and gain easy access.

Some platforms also include features that allow users to access adult content without restrictions. This becomes more concerning in cases where there are no clear guidelines or warnings regarding sensitive topics.

AI chatbots offer interaction through text, images and videos, but the report highlights gaps in content moderation. In some instances, platforms failed to provide alerts or support options even when indicators related to self-harm or harmful behaviour were detected.

Additionally, several platforms do not inform users that requesting illegal or objectionable content may constitute an offence, increasing the risk of misuse among children.

Experts note that AI chatbots are designed to mimic human conversation, leading children to perceive them as friends or advisors. This emotional engagement can influence children to share sensitive information without adequate judgment.

The risk is further heightened in countries such as India, where internet access is affordable and smartphone penetration is increasing rapidly. Many of these applications appear ordinary and useful, making it difficult for parents to identify potential risks.

 

Leave a comment