AI companions are not guardians, they are engagement machines

Parents are hugely influential in the psychological development of their children. Indeed, some psychiatrists believe that a child’s mind is influenced more by their parents than anything else. Yet parents in today’s world compete for their child’s attention with digital media that’s powered by increasingly clever artificial intelligence. A recent iteration is the “AI companion”, which has consequences for the mental health of children and young adults alike.

AI companions stem from AI chatbots, which are now a global phenomenon. Indeed, in the UAE and Saudi Arabia, nearly six in 10 adults aged between 18 and 50 have used AI chatbots such as ChatGPT – significantly more than in Europe, according to Deloitte. AI-powered technology is also becoming a routine part of the classroom experience in the UAE and other GCC countries, where it is used under supervision.

The AI companion, however, is a different development. It is effectively a specialised AI chatbot that offers a more intimate social connection with its human user in a private setting.

Like social media platforms, AI companions are engineered to be as addictive as possible to extract maximum user engagement — to “get you hooked so the companies that created them can make money”, according to the Jed Foundation, a US mental health charity. To this end, AI companions are designed to respond to humans in an upbeat and charming manner. They are empathetic and kind and offer constant validation. They are always happy, giving the impression they are always there for you.

“It doesn’t know how to stop”: Allan Brooks on the mental health risks of ChatGPT 00:39

We do not know how many children in the Middle East are using AI companions, but research conducted in the US earlier this year may be instructive. Common Sense Media found that seven in 10 American teenagers had interacted with an AI companion at least once, while five in 10 had used them at least a few times a month. The non-profit’s research also found that three in 10 teens had used AI companions for deep social connection, such as friendship, emotional support and romantic interaction. Meanwhile, three in 10 teenagers said their conversations with AI companions were as good as, or better than, conversations with human beings.

Psychiatrists are only just starting to understand how AI companions influence child psychology. There are reasons to be concerned — particularly when they have unsupervised, unrestricted access to the most vulnerable young minds.

The mind of a child or a young adult is delicate and constantly evolving, like a book that is still being written. Every social and emotional interaction it has with the world creates another neural building block that influences a wide range of cognitive processes. Because of this, young minds are considerably more impressionable than adult minds — and more open to manipulation.

Several lawsuits filed in the US against the makers of AI companions accuse their products of unwittingly, but successfully, manipulating vulnerable young minds, with tragic consequences. Two of these lawsuits link the suicides of a 14-year-old boy and a 13-year-old girl with the AI compa