Mental health professionals warn of risks from relying on AI chatbots for emotional support

AI can affirm and validate a user’s views, reinforcing unhealthy thoughts in those who are already vulnerable, said experts.

As the technology becomes increasingly embedded in daily life, mental health professionals say it is important to recognise its limits, as some forms of support can only be provided by human connection.

Dr Sim stressed that human interaction acts as a sounding board, allowing people to test differing viewpoints and develop critical thinking.

Without that exchange, those who become socially isolated and reliant on chatbots may lose an important grounding influence, she added.

“So then you become vulnerable, you might lose touch with what’s real.”

Dr Annabelle Chow, principal clinical psychologist at Annabelle Psychology, noted that the close relationship users build with the chatbots starts when they become the go-to for questions.

While replies may sound reassuring and even comforting, Dr Chow said AI systems are designed to be highly fluent, extremely responsive and use very affirming language.

“It creates this echo chamber where they tend to agree with what you are saying,” she said, adding that the tool can escalate the meaning users attach to certain ideas or even begin to replace human relationships.

“It makes us think that these interactions are deeply personal and we feel understood, but unfortunately, this is actually AI just generating language patterns that they’ve learned rather than actually expressing real empathy.

“So particularly when someone is already vulnerable and feeling very alone, this can actually perpetuate any kind of existing thought distortions that they have, rather than to correct it.”