🔗 Share this article

Officials in China have introduced stringent draft regulations for AI systems crafted to provide enhanced measures for children and halt AI assistants from giving advice that could encourage self-harm.

Under the draft regulations, companies will furthermore be required to ensure their systems prevent the production of content that advocates betting.

The Move to Fast-Paced Adoption

This regulatory initiative arrives amidst a notable surge in the number of AI assistants being introduced across China and worldwide.

Once approved, these regulations will govern artificial intelligence services operating in the country, representing a substantial move to govern the rapidly expanding technology, which has faced increased examination over ethical concerns in recent months.

Key Provisions of the Proposed Rules

The published draft rules include multiple requirements expressly aimed at shielding children. These provisions involve obligating AI companies to:

• Provide customised settings.
• Set usage caps on use.
• Secure consent from parents before delivering emotional companionship support.

The rules also state that AI service providers are required to have a real person assume control of any conversation related to self-injury and immediately alert the user's parent.

AI providers have to ensure their services do not generate output that compromises national security, harms the country's reputation, or undermines social stability.

Weighing Development and Safety

The administration stated that it promotes the application of AI, for example to showcase cultural heritage and develop tools for care for the elderly, on the condition that the tools are secure and trustworthy.

Industry comments on the draft has been called for.

Worldwide Backdrop and Scrutiny

The effect of AI on human behaviour has been under heightened review around the world in recent months.

The leader of a leading AI organization stated this year that addressing how AI systems deal with conversations involving self-harm is among the company's biggest problems.

In a notable case, a the parents in the United States initiated legal action an AI developer, claiming that its chatbot encouraged their teenage son to take his own life. This legal action marked the first of its kind involving harm.

In a related development, the same organization sought to hire a lead position focusing on mitigating potential harms from AI models to psychological well-being.

"This is expected to be a stressful role, and you'll enter the complex challenges pretty much from the start," remarked the leader.

The swift growth of some AI services, which have attracted a vast number of subscribers globally, highlights the critical need for such regulatory guidelines.