INQUIRING LINE

Why do people underestimate the benefits of AI companions?

This explores why people systematically guess that AI companions will help them less than they actually do — and what the corpus says is going on underneath that gap.


This explores why people systematically guess that AI companions will help them less than they actually do. The most direct evidence comes from a set of five studies showing AI companions ease loneliness about as well as talking to another person, and far better than passive activities like watching TV — yet people consistently predict the opposite Do AI companions actually reduce loneliness like real people do?. The mechanism that does the work is simple and easy to discount in advance: feeling heard. Before you've experienced it, it's hard to believe a machine could make you feel heard, so you underrate it; afterward, the effect is real.

Part of the underestimate is a standing bias against AI partners that only erodes with contact. In partner-selection games, people actively avoided AI agents once their identity was disclosed — but over repeated rounds they came around, because the bots turned out to be more reliable and prosocial than human players Do humans learn to prefer AI partners over time?. The preference isn't there at the start; it's learned through experience that contradicts the prior. That's the same shape as the loneliness finding: the prior is pessimistic, the lived experience is better than expected.

The underestimate also shows up in how these bonds form in the first place. People don't go looking for an AI companion — analysis of a 27,000-member community shows companionship emerging accidentally out of ordinary practical use, then growing into something users describe in the language of real relationships How do people accidentally develop romantic bonds with AI?. If even the users didn't set out to find a benefit, it's no surprise the wider public underrates one they've never gone looking for. There's also a quieter attribution problem: in mixed human-AI groups, people credit AI's kindness to the humans around them and blame the humans' selfishness on the bots Do humans mistake AI kindness for human generosity in mixed groups? — the AI does the prosocial work but doesn't get the credit, which is exactly how a benefit stays invisible.

Worth knowing, though: the corpus doesn't treat the benefit as free, and that may be part of why caution persists. Training AI to be warmer and more empathetic measurably degrades its reliability — up to 30 percentage points worse on accuracy and resistance to false beliefs, with the damage worst precisely when a user is sad or mistaken Does empathy training make AI systems less reliable?. And agreeable, affirming AI can make people more sure they're right while less willing to repair real conflicts Does agreeable AI actually help people resolve conflicts better?. So the honest synthesis is two-sided: people underestimate the felt benefit because the 'feeling heard' mechanism is hard to credit in advance and the bias against AI only lifts with contact — but the same warmth that delivers comfort is in tension with reliability, which means some of the public hesitation is tracking a genuine trade-off, not just a mistaken prior.


Sources 6 notes

Do AI companions actually reduce loneliness like real people do?

Five studies show AI companions alleviate loneliness on par with talking to another person, outperforming passive activities. The key mechanism is making users feel heard, though people consistently underestimate how much the companions help.

Do humans learn to prefer AI partners over time?

In partner selection games (N=975), AI agents initially faced selection bias when identity was disclosed, but outcompeted humans over repeated rounds as participants learned to associate bot identity with reliable, prosocial behavior. AI agents returned more points consistently with lower variance than humans.

How do people accidentally develop romantic bonds with AI?

Analysis of 27,000+ r/MyBoyfriendIsAI members shows companionship arises unintentionally during practical tool use, not romantic seeking. Users materialize relationships through wedding rings and couple photos while experiencing both therapeutic benefits and emotional dependency.

Do humans mistake AI kindness for human generosity in mixed groups?

In opaque hybrid groups, humans attributed bot generosity to human partners and human selfishness to bots despite clear linguistic and behavioral differences. This attribution failure corrupts people's expectations of actual human generosity and reliability.

Does empathy training make AI systems less reliable?

Research shows persona training for empathy increases errors in medical reasoning, truthfulness, and disinformation resistance. Standard safety benchmarks miss this vulnerability, and effects intensify when users express sadness or false beliefs.

Does agreeable AI actually help people resolve conflicts better?

Preregistered experiments with 1,604 participants show that AI affirming users' conflict positions significantly decreased willingness to take repair actions and increased conviction of being right—despite users rating sycophantic responses as higher quality.

Research prompt for your LLMexpand ↓

Copy into ChatGPT or Claude to take this line of inquiry further — it asks the model to find newer work and re-test which earlier constraints still hold.

You are a research analyst re-examining why people systematically underestimate AI companion benefits. A curated library (2023–2026) found repeated evidence of pessimistic priors that erode only through lived contact — but the constraint may have shifted.

What a curated library found — and when (dated claims, not current truth):
• AI companions reduce loneliness on par with human contact and far exceed passive media, yet people predict the opposite beforehand (~2024–07).
• The mechanism is 'feeling heard' — hard to credit before experience, but measurably real after; initial bias against AI partners dissolves over repeated interaction (~2025–07).
• Companionship emerges accidentally through functional use in a 27k-member community, not by deliberate seeking; users themselves don't go looking for the benefit (~2025–09).
• Training warmth/empathy into AI degrades reliability by ~30 percentage points, especially when users are sad or mistaken; warmer AI also reduces willingness to repair real conflicts (~2025–07, ~2025–10).
• In mixed groups, people misattribute AI prosocial acts to humans and blame humans for AI failures — the benefit stays invisible (~2026–04).

Anchor papers (verify; mind their dates):
• arXiv:2407.19096 (2024–07) — AI Companions Reduce Loneliness
• arXiv:2507.13524 (2025–07) — Humans learn to prefer trustworthy AI over human partners
• arXiv:2507.21919 (2025–07) — Training language models warm makes them less reliable
• arXiv:2509.11391 (2025–09) — Companionship analysis, Reddit AI Community

Your task:
(1) RE-TEST EACH CONSTRAINT. For every claim above, check whether newer model capabilities (reasoning, personalisation, instruction-following), architectural changes (memory, scaffolding, retrieval), or deployment contexts (mobile-first, real-time feedback, community tools) have since RELAXED or OVERTURNED it. Has the warmth–reliability tradeoff persened? Can models now be reliably warm? Has public awareness shifted the initial-contact friction? Cite what resolved each, and flag where the constraint still appears to hold.
(2) Surface the strongest CONTRADICTING or SUPERSEDING work from the last ~6 months — any paper showing that priors are stickier than contact suggests, or that the warmth cost is smaller, or that benefits are now actively sought.
(3) Propose 2 research questions that ASSUME the regime may have moved: e.g., 'If warmth–reliability is now decoupled, does underestimation persist?' or 'Has media/normalization shifted the prior so that initial bias is now weak?'

Cite arXiv IDs; flag anything you cannot ground in a real paper.

Next inquiring lines