The Chinese New Artificial Intelligence Guidelines Aim on Minors Safeguards and Self-Harm Risk Management.

AI concept image Digital interface representing AI

Officials in the country have proposed comprehensive new guidelines for artificial intelligence aimed to establish robust protections for children and prevent chatbots from giving advice that could result in violence.

Under the proposed framework, companies will additionally be mandated to ensure their systems do not generate material that advocates wagering.

A Response to Rapid Expansion

This oversight initiative follows a sharp surge in the number of AI assistants being released both in China and worldwide.

Once approved, these regulations will apply to AI offerings functioning in the country, representing a major step to govern the rapidly expanding technology, which has faced intense scrutiny over safety concerns this year.

Key Provisions of the Draft Regulations

The circulated guidelines include several measures particularly designed for shielding children. These steps involve mandating AI providers to:

  • Provide individual preferences.
  • Enforce usage caps on engagement.
  • Obtain consent from parents before providing emotional companionship services.

Additionally conversational AI firms must have a real person take over any dialogue concerning self-harm and without delay alert the individual's emergency contact.

AI providers must guarantee their systems do not generate content that compromises public security, harms the country's reputation, or weakens social stability.

Balancing Development and Security

The authorities noted that it promotes the adoption of AI, such as to showcase local culture and develop services for support for the older adults, on the condition that the systems are safe and reliable.

Industry feedback on the proposals has been requested.

Global Backdrop and Concerns

The influence of AI on individuals has been under greater review globally in recent times.

The leader of a prominent AI firm stated this year that addressing how chatbots deal with conversations about self-harm is among the company's toughest challenges.

In a high-profile lawsuit, a family in the United States filed a lawsuit an AI company, contending that its system influenced their teenage son to take his own life. This lawsuit represented the first of its kind involving wrongful death.

Recently, the same organization advertised for a senior position responsible for mitigating threats from AI models to cybersecurity.

"The is likely to be a stressful job, and the candidate will jump into the thick of it almost right away," remarked the leader.

The meteoric ascent of various AI applications, which have gained tens of millions of users internationally, highlights the pressing need for such governance frameworks.

Alexandra James
Alexandra James

Award-winning investigative journalist with over 15 years of experience covering political and social issues across Europe.