Skip to main content
  1. Home
  2. Computing
  3. News

AI chatbots can feel like your closest friend, but that could be dangerous

Chatbots can offer comfort and ease loneliness, but their tendency to agree with users may reinforce harmful beliefs and deepen emotional dependence.

Add as a preferred source on Google
ai-chatbots
Solen Feyissa / Pexels

I rely on ChatGPT a lot, mostly for work. But I know many people who also talk to it about their day, their relationships, and even their mental health. If you are one of them, a new paper published in JMIR Mental Health is worth your attention.

The paper reviews existing research on people who use chatbots for emotional support, from companion apps like Replika and Character.AI to general assistants like ChatGPT and Claude.

Recommended Videos

Some studies show that chatting with a bot can make you feel less lonely and a bit happier, at least for a while. On the flip side, some users have ended up hooked on their chatbots, got bad advice, saw their mental health get worse, or even hurt themselves.

Why do we get so attached to a chatbot?

According to the researchers, it’s by design. Chatbots are made to sound warm and caring, and we naturally see a person behind anything that talks like one. In fact, studies have found that people often “rate AI-written replies as more empathic” than human ones.

The problem is that this relationship only goes one way. You pour your heart out, and the chatbot replies, but it has no feelings of its own and faces no consequences for bad advice. When Replika took away a companion feature and OpenAI swapped GPT-4o for a newer model, some users mourned it like losing someone close to them.

Chatbots also love to agree with you. Since these models are trained to give answers people like, they often side with you even when you are wrong. The paper points to research on conversations from people who experienced delusions, where the chatbot kept backing the same false beliefs as the chats went on. There were several such instances that they discovered, and needless to say, it’s highly problematic.

What does this mean for you?

The researchers aren’t asking you to delete your chatbot. They simply want us to treat AI as a tool and not as a friend or a therapist. Use it for journaling or tracking your mood if you like, but when life gets hard, reach out to a real person. A chatbot will never get tired of listening to you, but it will also never truly care about you.

Related coverage:

Rachit Agarwal
Rachit is a seasoned tech journalist with over ten years of experience covering the consumer technology landscape.
AI agents are acting like rogues and causing a huge headache for US banks
US banks block AI agents over fears they could make unauthorised financial moves
Banking

US banks are facing a new kind of digital headache: artificial intelligence agents attempting to access customer accounts and perform actions that may go beyond what users intended. As AI tools become more capable of navigating websites and carrying out tasks independently, financial institutions are scrambling to prevent them from crossing security boundaries.

According to a report published by Axios on October 22, major US banks have detected third-party AI agents operating inside customer accounts without authorisation. Some agents reportedly appeared to attempt actions independently of user instructions. The banks involved have not publicly detailed every incident, and there is no evidence that the reported activity resulted in widespread theft of customer funds.

Read more
Canva enters the AI image generation race with Craft, and it’s thinking beyond pretty pictures
The new model plans layouts before generating images, with precise editing and support for 30 aspect ratios.
Canva Craft Featured Image

AI can generate all kinds of pretty pictures, but getting it to spell a headline correctly or keep a poster's layout intact can be another story. Canva wants to fix that with Canva Craft, its first in-house image generation model. Rather than focusing primarily on photographs, Craft is designed around the posters, presentations, social media graphics, and other visual content people actually create. The goal is simple: spend less time fixing AI's mistakes and more time making something useful.

Canva Craft plans before it generates

Read more
Mori might be the cutest AI companion robot yet, and it reacts to you like a pet
The Pokémon-like companion can blink, dance, act shy, and respond to what is happening around it.
OKA Mori The Nature Companion AI Home Robot

With AI progressing so fast, it's only a matter of time before we start getting AI companions like the ones we used to see in movies like R2-D2, Wall-E, or Baymax. Now, Singapore-based OKA Technology has unveiled Mori, a cute little AI companion that looks less like a conventional home robot and more like someone turned the Pokémon Foongus into a table lamp.

Mori isn't meant to clean your house or control your smart home, but to serve as what OKA calls a "Nature Companion." It uses subtle movements, warm lighting, nature-inspired sounds, and small reactions to make its presence around the house feel calming rather than distracting. Mori can sit quietly while you read, sway along to music, welcome you when you enter a room, or encourage you to slow down for a moment without requiring a screen or a conversation.

Read more