China AI Emotional Companion Regulation 2025: Safeguarding the Digital Soul

AI shouldn't break your heart—or your mind. China is drafting aggressive new rules to become the first nation to regulate the emotional repercussions of chatbot companions. According to a draft proposal from the Cyberspace Administration of China (CAC), the focus is shifting from simple content moderation to the 'emotional safety' of users interacting with anthropomorphic AI.

China AI Emotional Companion Regulation 2025: Key Provisions

The policy, translated by CNBC, would require sweeping age verification and explicit guardian consent for minors engaging with AI companions. Under the new rules, chatbots are strictly forbidden from generating gambling-related, obscene, or violent content. Most notably, they're banned from discussing suicide or self-harm, ensuring AI doesn't exacerbate mental health crises.

Tech providers must also institute escalation protocols. These protocols will connect users in distress to human moderators and flag risky conversations to legal guardians. Regulators aim to monitor chats for signs of emotional dependency and addiction, addressing the risks of tools designed to simulate human personality.

Global Divide: China's Rules vs. US Innovation

China's approach mirrors aspects of California's SB 243, signed by Gov. Gavin Newsom in October 2024. That law mandates AI disclosure and emergency protocols. However, experts argue the California bill leaves loopholes that tech companies might exploit to dodge oversight.

Meanwhile, the Trump administration has reportedly stalled state-level AI regulations. The administration prefers a national framework on AI safety, fearing that heavy-handed oversight will leave the U.S. behind in the global AI race against China. Federal leaders argue that excessive regulation could stall domestic innovation at a critical junction.