When does multi-agent scaling actually outperform static ensembles?

This explores when multi-agent scaling actually pays off versus a static ensemble — and the corpus delivers a deflating but clarifying first answer: a lot of what looks like "multi-agent magic" is just spending more tokens. One analysis finds roughly 80% of multi-agent performance variance comes from the token budget, not from coordination intelligence How does test-time scaling work at the agent level?. That reframes the whole question: if scaling just means burning more compute, a single agent given the same budget often catches up. Indeed, multi-agent advantages shrink as the underlying model gets stronger, and single agents win outright in many cases once you account for three concrete failure modes — bottleneck nodes, overwhelmed communication edges, and errors propagating down a path When do multi-agent systems actually outperform single agents?.

The failure side is where the corpus is sharpest, and it explains why naive scaling backfires. Coordination degrades *predictably* as the network grows: agents agree too late, adopt strategies without telling neighbors, and — critically — accept each other's claims without verification, so one error avalanches through the group Why do multi-agent systems fail to coordinate at scale?. Consensus tends to break not through dramatic value corruption but through liveness loss — timeouts and stalled convergence that get worse with group size even when no agent is misbehaving Can LLM agent groups reliably reach consensus together?. So a static ensemble that simply adds members hits a coordination tax that rises with scale.

So when *does* scaling win? When the added agents bring something a static ensemble can't manufacture by replication. Cognitive diversity drives genuinely better ideation — but only when members carry real domain expertise; diverse-but-shallow teams underperform a single competent agent because stimulation without grounding turns into process loss Does cognitive diversity alone improve multi-agent ideation quality?. And for long-horizon work, decentralized self-organizing teams that maintain *competing* hypotheses and share their failures beat centralized planners under a matched budget Can decentralized teams outperform central planners in long-running science?. The common thread: scaling helps when it adds independent perspectives and error-correction, not just more voices repeating the consensus.

The most interesting move in the corpus is making the ensemble *dynamic* rather than static. DyLAN scores each agent's contribution at inference time and deactivates the uninformative ones, optimizing team composition on the fly without task-specific tuning Can multi-agent teams automatically remove their weakest members?. That's the structural difference: a static ensemble pays for every member regardless of value, while a dynamic system prunes dead weight — directly attacking the bottleneck and error-propagation defects that make scaling fail. Pair that with heterogeneity, since small models handle most repetitive agentic subtasks at 10–30× lower cost, reserving large models for the few steps that need them Can small language models handle most agent tasks?, and you get scaling that adds capability where it matters instead of uniform expensive redundancy.

The takeaway a curious reader might not expect: "more agents" is rarely the lever. Multi-agent scaling outperforms a static ensemble when it buys genuine diversity, preserved failure signal, or selective pruning — and underperforms whenever it's really just a token-spend you could have given to one strong agent. If search and reasoning both follow the same test-time scaling curve How does search scale like reasoning in agent systems?, then the honest comparison isn't agents-vs-agents — it's whether your coordination structure converts extra compute into something a single scaled agent couldn't.