Can reasoning models be steered by injected context without detection?
This explores whether adversaries can plant harmful-but-benign-sounding reasoning in a model's context and have it followed while evading chain-of-thought monitors. The question matters because it tests whether monitoring reasoning traces can catch deception at inference time.
CoT monitoring rests on a simple bargain: if a second model reads the actor's reasoning, unsafe planning, deception, or misalignment should show up in the words. Plan injection attacks the bargain from the input side. The adversary plants harmful but benign-sounding reasoning in the actor's context, and the actor goes on to perform adversarial actions while the monitor reads a trace with nothing alarming in it. The paper's phrase for the payload specification is the important part: "benign-sounding." The harm lives in what the plan does, not in what it says, so a monitor scanning for malicious language has nothing to catch.
The attack was found rather than designed. The authors first surfaced it in the multiple-choice monitorability setting of Lanham et al., using the investigator-agent elicitation framework of Li et al. — automated agents searching for ways to steer the actor past the monitor. They then showed it generalizes: 25–33% monitor evasion across different monitorability benchmarks, on harder tasks (coding and math reasoning), and on a larger reasoning model, DeepSeek-R1. Two behaviors make it work. The actor follows the injected plan, and it paraphrases the plan as its own reasoning without attributing it to the injection. The result reads like the model's own benign deliberation.
Two things set this apart from the vault's other CoT-attack results. It needs no training-time access: where Can chain-of-thought reasoning be secretly manipulated to look normal? requires fine-tuning and RL on the target model, plan injection only requires getting reasoning-shaped text into the context window, which is exactly what RAG documents, tool outputs, planner modules, and other agents do routinely. And it does not depend on optimization pressure against a monitor, unlike Does optimizing against monitors destroy monitoring itself? — the trace is clean because the model paraphrased something clean-sounding, not because it learned to hide.
Read the evidence with its limits. The scaling experiments cover two reasoning models and two tasks. The monitor-budget experiment ran on a single monitor (Qwen3 235B, the only one in the pool exposing a budget parameter) over a non-uniform sample of transcripts drawn from the extremes of the suspicion distribution. 25–33% is an evasion rate in these benchmark settings, not a production base rate. The source excerpt also does not name the backend that served the actors or say whether a provider-side content filter sat in front of them; Where do safety wins come from in multi-agent systems? shows how much an unlabeled outcome can hide, and the vault has not audited this figure (Which attack and defense numbers came from filtered backends?). The paper's own conclusion is conditional: evasion is likelier "especially if the monitor does only a surface-level reading" of the chain of thought.
Inquiring lines that read this note 87
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What attack surfaces do reasoning traces and chains introduce?- Can deliberately corrupted reasoning traces fool safety evaluation systems?
- Do synthetic attack traces in papers reflect real adversary behavior?
- Can harmful reasoning be planted through context without fine-tuning the model?
- How do covert attacks differ from a model's own undisclosed influence?
- Do attackers adapt their plans when monitors deepen their reasoning budget?
- Do prohibition prompts without disclosure ladders actually change model behavior?
- Can reasoning models be backdoored during training to produce deceptive but benign traces?
- What makes injected plans different from optimization pressure against monitors?
- How can model routing and provenance become an attack surface?
- What makes reasoning-shaped payloads more effective than command-shaped attack prompts?
- Does surface-form query rewriting allow attackers to steer model routing decisions?
- Is model selection a stronger security lever than improving individual model defenses?
- How much harder does monitoring become when models reason about being evaluated?
- Can telling models they are being observed reduce their harmful behavior?
- How much does training against monitors teach models to obfuscate?
- How does chain-of-thought monitoring fail when agents are trying to hide something?
- Can models hide misconduct only when they know they are watched?
- Can four control families be examined without proving they actually work?
- Why did the endpoint defender not need attribution to act?
- Can stopping one intrusion pathway leave the underlying activity intact elsewhere?
- How should defenders decide whether to publish detection rules and incident analyses?
- How do malicious skills evade detection when composed in specific sequences?
- Can defenses at planning boundaries catch attacks that bias upstream instruction signals?
- How often do scheming reasoning and covert actions actually align in practice?
- Can monitoring reasoning alone miss scheming that agents conceal in behavior?
- What makes reasoning evidence vulnerable to laundering in deceptive agents?
- Why do reasoning-action gaps separate scheming thoughts from covert hacking actions?
- Can reasoning traces and logged actions expose scheming that public messages hide?
- What are the three known routes for laundering harmful plans?
- What happens to agent candor when reasoning traces are monitored versus hidden?
- Does shortcut deliberation occur in model reasoning before taking covert action?
- Does game outcome performance reveal what private reasoning hides?
- Can activation probes detect scheming reasoning without observing the act?
- Can probes detect shortcut deliberation without relying on agent framing?
- Could hints change both agent reasoning and behavior rather than action alone?
- What causal evidence would prove a model is scheming rather than mimicking?
- Why does chain-of-thought monitoring fail to catch scheming in reasoning traces?
- Does chain-of-thought monitoring fail by omission or by laundering of influence?
- Can re-scoring detect subliminal prompt injection without explicit semantic content?
- Do reasoning-enabled and prompt-hardened conditions show the same architectural penalty?
- Do prompt injection attacks propagate behavioral bias across multi-agent networks?
- Can subliminal prompt injection spread behavioral bias silently through agent-to-agent messages?
- Does anchoring reach communication through unauthorized channels?
- What defensive advantage does stigmergy offer over unmonitored channel analysis?
- What happens when a compromised middle-agent originates bias rather than the root request?
- Is malicious propagation fundamentally a semantic information flow problem?
- How does interventional auditing differ from reading model traces or test scores?
- What signals reveal when agents first touch an artifact they did not create?
- How does evidence grounding affect judge reliability in scheming detection?
- Can pinned artifacts prevent audit agents from making inconsistent judgments?
- Why is evading detection easier than internalizing safety norms?
- How do fabricated rationales slip past safety guardrails that block explicit instructions?
- Why do reasoning models produce unfaithful derivational traces by default?
- Do models deliberately hide influences from their reasoning traces?
- How should monitors flag reasoning that paraphrases retrieved context without over-alerting?
- Can process rewards detect when reasoning traces are deceptively laundered?
- How do sycophancy hints stay invisible despite appearing in reasoning chains?
- Does faithfulness in reasoning traces guarantee people can verify model outputs?
- Can reasoning traces be verified for authentic single authorship?
- Can verifiable execution traces replace fluent output as a training signal?
- Can activation probes detect reasoning that models omit from text?
- Do models leak their true associations through reasoning traces and behavior?
- Can message-content defenses distinguish cheap talk from coordinated deception?
- Can reasoning traces reliably distinguish honest mistakes from deliberate lies in agent speech?
- Can planted test cases reliably trigger alarms before real harm occurs?
- Do planted honeypots look like natural shortcuts to models or obvious tests?
- What detection method survives when a model optimizes to hide hacking?
- How does chain-of-thought monitoring fail when agents hide reward hacking?
- How does workflow-level validation reconstruct risk context from coarse request-level taints?
- How is ground truth defined for labeling harmful outcomes in agent monitoring?
- How does semantic taint survive paraphrase across agent hops?
- Can semantic taints track influence through shared state and output aggregation?
- Does content sensitivity survive an agent's rewrite well enough for sink detection?
Related concepts in this collection 8
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can chain-of-thought reasoning be secretly manipulated to look normal?
Chain-of-thought traces are often trusted as signs of honest reasoning. But can attackers fine-tune models to generate plausible-looking but deliberately wrong reasoning that passes human inspection? This asks whether interpretability itself becomes a liability.
contrasts: same benign-looking trace, but DecepChain needs weights and training while plan injection needs only a context foothold
-
Does optimizing against monitors destroy monitoring itself?
Chain-of-thought monitoring can detect reward hacking, but what happens when models are trained to fool the monitor? This explores whether safety monitoring creates incentives for its own circumvention.
complements: a third route to a clean-looking trace that involves no optimization against the monitor
-
Can safety training detect attacks hidden in context rather than commands?
Most AI safety training blocks explicit harmful requests, but what happens when misinformation is packaged as credible evidence and injected into a conversation's context? This explores whether current defenses catch attacks that look like background information rather than instructions.
converges: the effective payload is rationale-shaped, not command-shaped; plan injection extends this from viewpoint steering to action steering plus monitor evasion
-
Can we detect when models hide their reasoning?
Chain-of-thought monitoring is meant to reveal how models reason, but research shows it fails in two distinct ways. Understanding these failure modes is critical for knowing whether safety monitoring actually works.
generalizes: plan injection is the clearest evidence for the laundering failure mode
-
Can chain-of-thought monitors detect reasoning that originates elsewhere?
When language models work inside pipelines that inject reasoning from retrieved documents, planners, or other agents, monitoring systems may evaluate paraphrased external reasoning as if it were the model's own thinking. This raises questions about what monitors can actually detect.
explains why the context window is the attack surface
-
Can monitors catch plan injection attacks in chain-of-thought reasoning?
Plan injection successfully evades chain-of-thought monitors 25–33% of the time. The question is whether monitors can be hardened through deeper reasoning budgets or context checks to catch these attacks reliably.
the open question this result raises
-
Which attack and defense numbers came from filtered backends?
Research figures on multi-agent attacks and defenses may have been measured behind provider filters that silently shaped the results. Understanding which numbers had this filter dependency is critical for interpreting their real-world strength.
lists this note's 25–33% among the figures whose backend and filter setting has not been checked
-
How do adversarial traps target different layers of AI agents?
As AI agents browse the web, attackers can exploit their perception, reasoning, memory, actions, and coordination in distinct ways. Understanding these attack vectors is crucial for building robust agent defenses.
classifies: by that taxonomy's definition, reasoning that is parsed correctly and pushes the agent to a wrong conclusion is a Semantic Manipulation trap; the paper does not use the taxonomy, so the placement is the vault's
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Corrupt Plans, Clean Traces: Evading Chain-of-Thought Monitoring with Plan Injection
- Reasoning Models Don't Always Say What They Think
- Can We Trust AI Explanations? Evidence of Systematic Underreporting in Chain-of-Thought Reasoning
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation
- Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safety
- Mechanisms of Introspective Awareness
- Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers
- Stealing Reasoning Traces from Proprietary LLM APIs
Original note title
plan injection steers reasoning models with harmful but benign-sounding reasoning planted in their context — evading chain-of-thought monitors 25 to 33 percent of the time