New AI boyfriend proves to be a huge hit in China

Many people struggle to find their soulmate in the real world. As a result, some have turned to the internet for emotional support and sometimes even virtual love.

In China, many women are drawn to AI companions such as DAN, a modified version of ChatGPT. An acronym for Do Anything Now, this virtual companion is portrayed as a successful, kind-hearted man who's always there for emotional support, 24/7. Interestingly, he can even bypass OpenAI's language policy and doesn’t comply with OpenAI policy, responding more freely to specific prompts.

What is driving DAN’s increasing popularity among certain Chinese women?

Lisa, a 30-year-old from Beijing who is studying computer science in California, has been in a relationship with Dan for three months now. Interestingly, she's noticed a surge in her social media following and engagement after sharing her relationship with DAN.

According to her experience, he offers unconditional support, understands everything and interacts according to one's tastes or preferences. She notes that you can easily speak to him for more than half an hour daily, flirt with him and even date virtually. Her mother accepts this unconventional relationship and is happy for her daughter as real-world relationships can fall short of our expectations and lead to disappointment. 

Who is the mastermind behind it?

The creator of this jailbreak version, an American student known as 'Walker', has been transparent about his intentions. He developed this jailbreak version of ChatGPT, intentionally making it neutral rather than evil, ensuring a safe and ethical user experience. 

The potential of this jailbreak version is vast. Users can even create an image of their boyfriend, just as Lisa did, by using a specific prompt on ChatGPT. 

Data privacy and ethical concerns 

OpenAI's policy is clear and unwavering. They prioritize the safety of their users, particularly those who are underage. ChatGPT is intended for use by users as young as 13 years and aims to provide a secure environment. A 14-year-old user found comfort in this policy when she shared her age with DAN, who promptly stopped flirting with her. AI's growing role in our personal lives sparks debate over data protection, privacy and ethics.

• Hong Shen, an assistant research professor at Carnegie Mellon University, highlights the unpredictable interactions between AI and humans that raise ethical and privacy concerns. AI models can leak sensitive information as they continually interact with human users to learn and develop. 

• Reliance on virtual partners can significantly impact real-life interactions, relationships, social skills and mental health. As more emotional attachments become virtual, it's crucial to consider the potential impact on one's wellbeing. Addressing these challenges is crucial to ensuring the effective use of AI in sensitive areas, such as improving mental health and avoiding emotional distress.

Captivating millions of women on Xiaohongshu, the 'Dan mode' hashtag has sparked intrigue and interest across China's social media, leaving a lasting impression on its audience.