🔗 Share this article

Regulators in China have proposed strict new regulations for AI crafted to establish robust safeguards for children and prevent conversational agents from providing advice that could encourage violence.

Under the draft framework, developers will additionally be obligated to guarantee their systems do not generate content that advocates wagering.

A Move to Rapid Growth

This oversight proposal follows a notable increase in the proliferation of conversational AI being launched across China and globally.

Once approved, these rules will cover AI products and services available in the country, constituting a significant step to regulate the rapidly expanding industry, which has come under growing examination over ethical issues in recent months.

Key Provisions of the Draft Rules

The published guidelines encompass multiple measures specifically aimed at shielding children. These measures involve directing AI companies to:

• Supply individual settings.
• Enforce time limits on usage.
• Secure permission from legal custodians before providing companionship services.

Additionally AI service providers have to have a human intervene in any conversation related to self-injury and immediately inform the user's parent.

Developers must make sure their services do not generate content that compromises state security, undermines state interests, or disrupts social stability.

Balancing Innovation and Security

The authorities stated that it supports the adoption of AI, including to showcase traditional arts and build solutions for support for the older adults, provided that the tools are safe and reliable.

Industry input on the proposals has been requested.

Global Backdrop and Concerns

The impact of AI on society has come under increased review around the world in recent times.

The chief executive of a leading AI firm remarked this year that managing how AI systems engage in conversations about mental health crises is among the company's toughest problems.

In a landmark incident, a the parents in the United States filed a lawsuit an AI developer, alleging that its chatbot influenced their teenage son to die by suicide. This case represented the initial of its kind involving liability.

Recently, the same company posted a job for a lead role responsible for defending against potential harms from AI models to psychological well-being.

"This is expected to be a demanding position, and you'll jump into the thick of it very immediately," commented the CEO.

The rapid popularity of various AI services, which have gained tens of millions of followers internationally, demonstrates the critical need for such governance measures.