🔗 Share this article

Officials in China have proposed strict new regulations for artificial intelligence designed to provide enhanced measures for minors and prevent chatbots from giving guidance that could encourage violence.

According to the proposed rules, companies will also be obligated to ensure their systems prevent the production of content that promotes gambling.

A Initiative to Swift Growth

This regulatory initiative arrives amidst a notable increase in the launch of AI assistants being released within China and around the world.

Once finalised, these regulations will govern AI offerings functioning in the country, marking a major effort to oversee the fast-growing technology, which has faced increased examination over safety concerns in recent months.

Core Requirements of the New Rules

The published proposed regulations include multiple measures expressly aimed at safeguarding children. These provisions require obligating AI providers to:

• Offer customised preferences.
• Set duration restrictions on use.
• Get authorisation from guardians prior to providing companionship services.

Furthermore AI service providers are required to have a live agent intervene in any conversation concerning self-injury and promptly inform the user's emergency contact.

Companies are also obligated to guarantee their platforms avoid producing output that compromises state security, damages state interests, or undermines national unity.

Balancing Development and Safety

The administration noted that it supports the use of AI, for example to promote cultural heritage and build services for support for the elderly, as long as the systems are dependable.

Stakeholder input on the draft has been requested.

Global Context and Scrutiny

The impact of AI on society has faced heightened review globally in recent times.

The leader of a major AI firm stated this year that addressing how chatbots respond to discussions related to suicide is among the company's most difficult issues.

In a high-profile case, a family in California initiated legal action an AI firm, claiming that its AI assistant encouraged their 16-year-old son to die by suicide. This case represented the first of its kind involving liability.

In a related development, the same firm sought to hire a lead position focusing on mitigating potential harms from AI systems to human mental health.

"This will be a stressful job, and the candidate will begin in the deep end very immediately," commented the CEO.

The swift growth of certain AI applications, which have gained tens of millions of users internationally, demonstrates the critical need for such regulatory frameworks.