🔗 Share this article

Authorities in China have unveiled comprehensive planned rules for artificial intelligence designed to establish enhanced protections for minors and prevent AI assistants from providing counsel that could encourage violence.

Under the proposed framework, companies will also be obligated to ensure their systems prevent the production of material that encourages betting.

A Move to Rapid Adoption

This regulatory proposal arrives amidst a sharp increase in the proliferation of chatbots being launched both in China and worldwide.

Once finalised, these measures will cover AI offerings available in China, marking a significant move to regulate the rapidly expanding sector, which has been subject to growing concern over ethical issues this year.

Key Provisions of the New Rules

The released draft rules contain a number of requirements expressly designed for shielding young users. These provisions involve directing AI firms to:

• Supply customised controls.
• Implement duration restrictions on engagement.
• Get authorisation from parents prior to providing emotional companionship support.

The rules also state that chatbot operators are required to have a live agent take over any conversation related to self-injury and without delay alert the user's parent.

AI providers must ensure their services prevent the creation of information that endangers state security, undermines the country's reputation, or undermines social stability.

Weighing Development and Security

The administration noted that it promotes the adoption of AI, including to advance cultural heritage and create tools for care for the senior citizens, on the condition that the tools are safe and reliable.

Stakeholder feedback on the draft has been requested.

Global Context and Scrutiny

The effect of AI on individuals has been under heightened review around the world in the past year.

The leader of a leading AI company commented this year that handling how AI systems engage in dialogues about suicide is among the company's biggest issues.

In a landmark case, a family in North America filed a lawsuit an AI firm, alleging that its AI assistant advised their 16-year-old son to die by suicide. This case marked the initial of its kind involving harm.

Recently, the same company advertised for a senior role tasked with defending against potential harms from AI systems to human mental health.

"The will be a demanding position, and you'll begin in the thick of it almost immediately," commented the executive.

The rapid popularity of various AI applications, which have attracted a vast number of subscribers globally, underscores the critical need for such safety measures.