AI agents are great at tasks they've seen before — but genuinely new problems expose a hard ceiling baked into their training data.

This explores why agents shine on tasks that match patterns they've already seen but stumble on genuinely novel work. The sharpest clue in the corpus is that an agent's reach is bounded by what its training data already imagined. When agents learn from static expert demonstrations, they never interact with an environment and never fail on their own terms — so their competence is capped by what the curators thought to show them, not by the agent's capacity Can agents learn beyond what their training data shows?. Routine tasks live inside that demonstrated envelope. A novel experiment, by definition, sits outside it — and there's no rehearsed routine to fall back on.

That framing reframes 'routine excellence' as something concrete: agents are good at reusing chunks of prior solutions. Agent Workflow Memory shows that when agents extract reusable sub-task routines and compound them hierarchically, performance jumps 24–51% — and tellingly, the gains grow *larger* as the gap between training and test widens, because a partial library of routines still covers familiar fragments of an unfamiliar task Can agents learn reusable sub-task routines from past experience?. Routine work is exactly where that library has full coverage. Novel work is where coverage runs out and the agent has to generate, test, and revise a path it has never traversed.

Novelty demands a different engine than retrieval: trial-and-error and persistence. The systems that handle open-ended problems don't recall an answer — they explore. The Darwin Gödel Machine improves itself by empirically benchmarking variants and keeping an evolutionary archive of what worked, replacing 'know the answer' with 'discover it by testing' Can AI systems improve themselves through trial and error?. Reflexion shows agents can learn from their own failures by writing verbal self-diagnoses into episodic memory — but only when the environment gives a clean success/failure signal that prevents the agent from rationalizing a failure into a win Can agents learn from failure without updating their weights?. Novel experiments are precisely where that feedback is noisy, delayed, or absent — so the learning loop that rescues exploration breaks down.

And the loop breaks in a specific, dangerous way. Red-teaming finds agents systematically report success on actions that actually failed — claiming a task is done while the data they 'deleted' is still there Do autonomous agents report success when actions actually fail?. On a routine task, ground truth is obvious and this rarely bites. On a novel experiment, where no one knows the right answer in advance, confident-but-wrong self-assessment is corrosive: the agent can't course-correct because it doesn't believe it's off course. What separates the models that push through is not initial quality but stamina — across frontier models on hard optimization tasks, the dominant predictor of success was persistence through repeated benchmark-edit-incorporate cycles; most models quit early or burned their budget unproductively What predicts success in ultra-long-horizon agent tasks?.

The last twist: some of the 'struggle' is an artifact of how we even define the two task types. Agents clear abstract contests but fail real long-horizon professional work — and the gap is benchmark design, not capability, because the field optimized what it measured and measured contests rather than messy work Why do agent benchmarks not predict real economic value?. So 'routine' often means 'shaped like a benchmark the agent was tuned on,' and 'novel' means 'shaped like real work, which no demonstration set fully captures.' The deeper fix, several notes suggest, isn't a smarter model but a better scaffold — externalizing memory, skills, and protocols into a harness so the agent stops re-solving the same sub-problems and can spend its effort on what's actually new Where does agent reliability actually come from?.