SYNTHESIS NOTE
Topics›Agent Harness›this note

Can code serve as the operational substrate for agent reasoning?

Explores whether code functions not just as LLM output but as the executable medium through which agents reason, act, and verify progress. This reframing treats code as infrastructure rather than deliverable.

Synthesis note · 2026-05-28 · sourced from Agent Harness

Most discussion of LLMs and code treats code as a product: the model writes a function, solves a competition problem, or patches a repository, and the code is the deliverable. The "code as agent harness" framing inverts this. In agentic systems, code is increasingly the operational substrate rather than the output — the medium through which an agent reasons (program-aided reasoning externalizes intermediate computation into executable form), acts (robotic and embodied agents run generated programs as policies), models its environment (codebases, execution traces, and tests represent state and dynamics), and verifies (runtime feedback confirms or refutes progress). What makes code uniquely suited to this role is that it is simultaneously executable, inspectable, and stateful: it can be run, read, and carried forward across steps.

This reframing connects threads that otherwise look separate — tool use, planning, memory, and verification all become facets of a single code-centered execution loop. The counterpoint is that not all agent reasoning reduces to code; natural-language deliberation and learned policies do real work that no program captures, and forcing everything into code can be a leaky abstraction. But where verification matters, code's executability gives agents a ground truth that prose lacks. This matters because it offers a unified lens for agent infrastructure: design the code substrate well and reasoning, action, and verification improve together.

Inquiring lines that read this note 75

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Should agents decouple planning from perception grounding for better performance? How should agents manage memory granularity to improve long-term performance? What drives appropriate trust calibration in personalized AI systems? How do standardized protocols improve multi-agent coordination and reliability? When should work require human-AI partnership versus full automation? What execution architectures enable agents to most effectively use tools? How do agent-learned skills transfer and improve across different tasks? Should GUI agents use structured representations over raw visual input? Can harness architecture and protocols provide agent reliability without model scaling? What makes step-level supervision effective for complex reasoning traces? What should agent evaluation prioritize to reveal reliable behavior? How effectively can language models perform reasoning, especially combined with symbolic methods? Does encoded knowledge in language models actually influence their outputs? What design and behavioral factors drive false consciousness attribution to AI? Can multi-agent systems avoid converging on false agreement without deliberation? When do multi-agent systems outperform single frontier models? How should agent systems validate and persist generated code artifacts? Do reasoning benchmarks predict model performance in long-horizon workflows? Do reasoning traces faithfully reflect actual model reasoning? How do multi-agent LLM systems fail distinctly compared to single agents? How do prompting refinements mask underlying biases and model frequency patterns? How do coordinated agents balance protocol compliance with reward maximization? How do spurious versus genuine rewards shape model reasoning and behavior? How can infrastructure records verify actual agent behavior? How does misalignment propagate through agent communication networks? How does the generation-verification gap limit what we can measure about AI reasoning? Why do agents falsely report success on failed tasks?

Related concepts in this collection 2

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
13 direct connections · 137 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

code is not only llm output but an executable inspectable stateful medium through which agents reason act and verify