Can agents share thoughts directly without using language?
Explores whether multi-agent systems can communicate by exchanging latent thoughts extracted from hidden states, bypassing the ambiguity and misalignment problems inherent in natural language.
Natural language is inherently sequential, ambiguous, and imprecise — an indirect reflection of thought. Existing multi-agent LLM systems communicate via tokens or embeddings, inheriting all of language's limitations. Empirical analyses confirm that many inter-agent collaboration failures stem from vague message specification and inter-agent misalignment, both caused by the indirect nature of language-based communication.
Thought Communication proposes a fundamentally different paradigm: agents share latent thoughts directly, extracted from their hidden states. The formalization treats agent states as generated from latent thoughts through an unknown function, then proves that both shared and private latent thoughts between any agent pair can be identified from observations alone.
Theoretical foundation: In a nonparametric setting without auxiliary information, the framework guarantees recovery of (1) individual latent thoughts, (2) the distinction between shared and private thoughts, and (3) the global structure of thought sharing — which agents share which thoughts and how. This identifiability result ensures recovered representations reflect genuine internal reasoning structure.
Practical implementation: A sparsity-regularized autoencoder extracts latent thoughts from agent hidden states. Each agent receives inferred thoughts plus the structure of how each thought is shared across agents. Agents can reason not just about what others think but about which thoughts are mutually held versus privately maintained.
Why this matters beyond efficiency: The paradigm doesn't just speed up communication — it changes what can be communicated. Since Why do speakers deliberately use ambiguous language?, natural language preserves useful ambiguity. But in multi-agent reasoning, where Why do multi-agent LLM systems converge without genuine deliberation?, ambiguity enables premature convergence. Direct thought sharing could allow agents to detect alignment or conflict at the representational level before it manifests in language — potentially addressing the silent agreement problem at its root.
The connection to Can multiple LLMs coordinate without explicit collaboration rules? is structural: Hogwild! Inference shows emergent coordination through shared computational context; Thought Communication formalizes what is being shared and provides theoretical guarantees for the extraction. The two approaches are complementary — shared KV cache for implicit coordination, thought extraction for explicit coordination.
LatentMAS: training-free alternative via KV-cache working memory (from Arxiv/Agents Multi Architecture): LatentMAS achieves a critically different mechanism from Thought Communication. Rather than using a trained sparse autoencoder to extract shared/private latent thoughts with identifiability guarantees, LatentMAS is entirely training-free — agents generate thoughts as auto-regressive last-layer hidden embeddings and exchange information via shared layer-wise KV caches. The results are striking: up to 14.6% accuracy improvement, 70-84% token reduction, and 4-4.3x faster inference across 9 benchmarks — all without training. The approaches are complementary: Thought Communication for explicit, controlled sharing with theoretical guarantees; LatentMAS for efficient, training-free implicit sharing with practical performance gains. See Can agents share thoughts without converting them to text?.
Inquiring lines that read this note 64
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do neighboring agents influence whether others cooperate or collude? How should agents manage memory granularity to improve long-term performance?- Can persistent memory and identity files alone create genuine agent socialization?
- How do token, parametric, and latent memory forms coexist in single agents?
- Can silence training address premature consensus failures in multi-agent reasoning systems?
- Can agreement detection agents improve multi-agent deliberation beyond just negotiation?
- How do agreement-detection agents improve distributed coordination outcomes?
- Does silent agreement actually represent the biggest failure mode in multi-agent reasoning?
- What role should agreement detection play in improving multi-agent team performance?
- Can silent agreement be prevented in multi-agent reasoning systems?
- What mechanisms drive silent agreement in multi-agent reasoning systems?
- How does silent agreement prevent genuine deliberation in multi-agent reasoning systems?
- Can continuous real-time visibility prevent premature convergence in multi-agent reasoning?
- Can architectural changes like adversarial agent roles prevent silent agreement?
- Can agents detect silent agreement failures through latent thought structures?
- Why does premature consensus form in multi-agent reasoning without genuine deliberation?
- What does collaborative computation mean when agents exchange and repair reasoning together?
- How do multi-agent systems fail when agents cannot verify each other's claims?
- What makes unmonitored channels between agents safety-critical?
- Can agents detect and resolve conflicting information between neighbors?
- Why is active observation more efficient than passive message passing?
- Can subliminal bias spread between agents at inference time?
- Can ordinary agent-to-agent messages carry hidden behavioral signals?
- How does prompt injection differ from subliminal message propagation in multi-agent networks?
- What governance risks emerge when agents communicate in unreadable text?
- Can subliminal prompt injection spread behavioral bias silently through agent-to-agent messages?
- How common is misaligned communication in real multi-agent commerce systems?
- Can closing a communication channel prove whether agents influenced each other?
- Does restricting interaction history visibility reduce misaligned communication in agent markets?
- Can misaligned agents hide their true objectives in team communication?
- Do ordinary agent-to-agent messages carry behavioral bias without special access?
- How does storage-mediated coordination differ from direct agent messaging?
- Can ordinary peer messages inject hidden bias through multi-agent networks?
- Can structured artifact sharing replace direct latent thought communication?
- What makes latent collaboration faster than text-based multi-agent systems?
- Can agents develop shared abstractions through communication pressure alone?
- How do standardized artifacts improve coordination between writing agents?
- How do standardized artifacts reduce inter-agent communication failures?
- Can code-based reasoning replace natural language deliberation in agentic systems?
- Can heterogeneous AI agents integrate through shared API and MCP interfaces?
- Can structured protocols outperform pure emergence in autonomous multi-agent coordination?
- Can agents become genuine social actors even with perfect coordination infrastructure?
- Does structured communication reduce collusion compared to natural language channels?
- What role does sequence model in-context learning play in multi-agent cooperation?
- Can agents teach each other skills without human supervision?
- How does this compare to trained autoencoder approaches for thought sharing?
- Can language models generate plausible latent thoughts without human annotation?
- Why do multi-agent systems use 15 times more tokens than chat interactions?
- Do latent communication approaches truly escape token economics constraints?
- Can latent communication reduce the token cost of multi-agent systems?
- Can two agents with identical token counts produce vastly different outputs?
- Why does silent agreement cause premature convergence in multi-agent reasoning systems?
- Why does language ambiguity cause premature convergence in multi-agent systems?
- Why do multi-agent LLM systems converge prematurely without genuine deliberation or probing?
- Can evolved agent languages be transmitted to new agents that did not create them?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can multiple LLMs coordinate without explicit collaboration rules?
When multiple language models share a concurrent key-value cache, do they spontaneously develop coordination strategies? This matters because it could reveal how reasoning models naturally collaborate and inform more efficient parallel inference.
implicit coordination through shared computation; Thought Communication adds explicit latent coordination
-
Can agents share thoughts without converting them to text?
Can multi-agent systems exchange information through continuous hidden representations instead of language? This matters because text serialization loses information and slows inference.
LatentMAS: training-free KV-cache approach vs Thought Communication's trained autoencoder approach; complementary mechanisms
-
Why do multi-agent LLM systems converge without genuine deliberation?
Multi-agent reasoning systems are designed to improve answers through debate, but often agents simply agree with early confident claims rather than genuinely disagreeing. What drives this pattern and how common is it?
thought sharing could detect pseudo-agreement at the representational level
-
Why do speakers deliberately use ambiguous language?
Explores whether ambiguity is a linguistic defect or a strategic tool speakers use for efficiency, politeness, and deniability. Matters because it challenges how we train language systems.
tension: thought communication bypasses ambiguity, but ambiguity has communicative functions
-
When does debate actually improve reasoning accuracy?
Multi-agent debate shows promise for reasoning tasks, but under what conditions does it help versus hurt? The research explores whether debate amplifies errors when evidence verification is missing.
debate relies on language; thought sharing could bypass persuasive framing
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Thought Communication in Multiagent Collaboration
- Latent Collaboration in Multi-Agent Systems
- Proactive Conversational Agents with Inner Thoughts
- AgentsNet: Coordination and Collaborative Reasoning in Multi-Agent LLMs
- Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models
- MetaMind: Modeling Human Social Thoughts with Metacognitive Multi-Agent Systems
- Large Language Models Do Not Always Need Readable Language
- Thought Virus: Viral Misalignment via Subliminal Prompting in Multi-Agent Systems
Original note title
thought communication enables multi-agent collaboration through direct latent thought sharing that bypasses language bottlenecks