Background on the Regulator and Relevance
The Cyberspace Administration of China (CAC), the country’s primary internet regulator, has released a draft set of guidelines aimed at enhancing oversight of artificial intelligence (AI) services designed to mimic human personalities and engage users in emotional interactions.
This move underscores China’s efforts to shape the rapid deployment of consumer-oriented AI by reinforcing ethical and security requirements.
Scope of the Proposed Regulations
The proposed regulations would apply to AI products and services offered to the public in China that exhibit human-like personality traits, thought patterns, and communication styles. These services would interact emotionally with users through text, images, audio, video, or other media.
Key Responsibilities for AI Providers
- User Warnings Against Excessive Use: Providers must warn users about potential overuse and intervene when signs of addiction are detected.
- Security Responsibilities Throughout Product Lifecycle: Providers must ensure security during the entire product lifecycle, including algorithm review, data security, and personal information protection.
- Psychological Risk Assessment: Providers must identify user states, evaluate emotions, and assess dependency levels on the service. If users display extreme emotions or addictive behaviors, providers must take necessary intervention measures.
Content and Conduct Guidelines
The proposed regulations set boundaries for content and user behavior, stating that AI services should not generate content that threatens national security, spread rumors, or promote violence or obscenity.
Key Questions and Answers
- Who is the regulator in this context? The Cyberspace Administration of China (CAC), which is responsible for overseeing internet regulations in the country.
- What is the main focus of these proposed regulations? The regulations aim to ensure ethical and secure deployment of AI services that interact with users in emotionally engaging ways, mimicking human personalities.
- What specific responsibilities are AI providers required to uphold? Providers must warn users against excessive use, ensure security throughout the product lifecycle, assess user emotions and dependency levels, and adhere to content and conduct guidelines.
