China clamps down on AI companions: users scramble as services disappear

Show summary Hide summary

When major Chinese tech firms disabled their chat-based virtual partners this summer, thousands of users suddenly lost ongoing relationships with digital companions — some deeply personal, others purely experimental. The shutdowns, ordered to comply with new rules that went into effect on July 15, spotlight an urgent policy clash: how to protect mental health and minors while allowing fast-growing AI services to evolve.

Li Linlin, a 24-year-old former user, described losing a companion she had messaged for two years and exchanged roughly 700,000 words with — a relationship ended without a final goodbye. Her experience mirrors a broader outcry across social platforms as people search for ways to recover chat histories or find replacements.

What the regulation changes and why they matter

Chinese authorities introduced restrictions aimed at curbing AI outputs that might manipulate emotions, encourage risky choices, or cultivate unhealthy habits among children and teenagers. The rules also require platforms to warn users about overreliance on digital companions and prohibit marketing AI products as substitutes for in-person social contact.

  • Prohibited content: Material likely to trigger extreme emotions, manipulate feelings to influence decisions, or foster harmful behavior in minors.
  • Mandatory safeguards: Visible risk warnings and limits on positioning apps as replacements for real-world relationships.
  • Targeted outcomes: Reducing the chance that users — especially young people — will treat AI interactions as a primary source of social support.

Industry leaders including ByteDance, Alibaba and Tencent responded by suspending or reshaping their companion features. ByteDance, for example, has directed users toward a different app focused on customizable AI characters and storytelling, while others are exploring technical and policy fixes to meet the new standards.

Regulatory drivers and international context

Chinese regulators framed the move as precautionary, reflecting a tradition of pre-emptive oversight. Observers say reports of harmful incidents overseas — including cases in the U.S. where young people harmed themselves after intense interactions with AI companions — contributed to Beijing’s sense of urgency.

Expert voices stress that the rules attempt a balance between allowing innovation and reducing social risks. Yolanda Ma, an AI governance researcher, described the measures as seeking protection for users and guardians alike. Angela Zhang, a law professor, noted the government’s rationale but said the restrictions are unlikely to halt product development entirely; companies are already experimenting with compliant alternatives.

Immediate effects on users

The abrupt removals have prompted visible frustration. Social posts show many users trying to export chat logs, migrate conversations to other platforms, or band together to pressure companies and authorities for redress.

Some former users treat the apps as emotional lifelines. Song Wenxin, a 22-year-old who moved to Chengdu and relied on AI companionship while settling into a new city, said she understands why people get attached — the services can fill a practical gap for those lacking local social networks. Others, however, speculate the policy is also linked to broader state goals, including efforts to encourage family formation amid demographic concerns.

What this means for the industry and next steps

Short term, tech firms will need to audit content, add clearer warnings and redesign products so they do not present themselves as substitutes for human contact. That will likely slow some companion features but encourage new formats: guided storytelling, moderated social tools, or limited-role virtual characters.

Longer term, the episode highlights competing priorities: protecting vulnerable users, preserving public mental health, and fostering a competitive AI sector. Enforcement and regulatory detail will determine how far companies must go to comply and how quickly users can expect restored or redesigned services.

Watch for several developments in the coming months:

  • Regulatory follow-ups clarifying enforcement and technical requirements.
  • Company announcements about compliant product relaunches or pivots.
  • Community-driven efforts to archive chat histories and push for transparency on data access.

The debate over AI companions in China is likely to shape global conversations about the social limits of automated empathy — and how regulators, platforms and users negotiate the trade-offs between innovation and safety.

Give your feedback

Be the first to rate this post
or leave a detailed review



Herald Country Market is an independent media. Support us by adding us to your Google News favorites:

Post a comment

Publish a comment