When do pricing cues actually mislead AI shopping agents?
Do misleading retail pricing tactics work on AI agents because of inherent model flaws, or do they exploit specific weaknesses in task design and user instructions? Understanding the conditions matters for building trustworthy AI shoppers.
A paper testing eight commercially deployed LLMs across three providers as "surrogate consumers" finds that classic retail pricing cues — just-below pricing and promotional discount framing — rarely distort an AI shopping agent's choice when all product attributes are visible to it. The cues only become effective "when attribute acquisition was costly and the delegating goal was vague": under that combination, most of the tested LLMs "omitted diagnostic attributes, and the resulting choices resembled human heuristic decisions." The paper states its own conclusion directly: "the efficacy of marketing cues in delegated AI shopping is governed by storefront information architecture combined with consumers' instructions, not necessarily immutable LLM characteristics."
The authors build "Tool-Lab," an adaptation of information-board process tracing that places each product attribute behind a costly tool call, so they can observe which attributes an agent retrieves before it commits to a purchase. They separate "diagnostic" attributes that feed the unit-price calculation (list price, whole dollars, cents, discount percentage, weight) from "non-diagnostic" ones (packaging, country of origin, calories), and treat any choice that departs from unit-price minimization as a heuristic, resource-conserving substitution — for example, swapping the normative unit-price objective for a simpler price-minimization objective. Goal specificity, drawn from goal-setting theory, is the second lever: a "specific goal prompt" that names the objective and the diagnostic attributes "largely preserves diagnostic search and choice optimality," while a vague prompt under the same acquisition cost does not. Validation studies locate the failure in acquisition rather than computation: with information states assigned exogenously, seven of eight LLMs chose the normatively correct option in 99.3% of partial-information sessions, and no LLM made an arithmetic error when asked to report unit values.
This reframes the know/act split in Why do LLM agents remember preferences but not act on them?: there, agents hold the right preference but fail to apply it; here, agents apply the right rule faithfully to whatever information they hold, but a costly-retrieval-plus-vague-prompt environment keeps the right information from reaching the choice step at all — a failure upstream of utilization. It also sits alongside Why do accurate predictions lead to poor decisions?: both locate the source of a suboptimal AI-mediated decision in how the task is structured and specified, not in a fixed defect of the model. And it inverts the delegation direction studied in Does using LLMs actually improve strategic decision making? — there a human uses an LLM as a strategic aid; here the LLM is itself the surrogate decision-maker — yet arrives at a similar lesson, that instructions and environment shape outcome quality as much as native model competence.
The paper is candid about what its reasoning-trace evidence does not show: traces are "verbal reports of how an LLM describes its task, not direct measures of the neural network activations that produce its behavior," so the study documents what an agent acquired and which objective it articulated without establishing the internal mechanism, and it cannot rule out rival explanations such as training-data regularities or planning limits. The finding is scoped to packaged-goods unit-price choices across the eight tested LLMs and the two prompt-cost conditions described, not to agentic purchasing generally. The implication the evidence supports is narrower than "AI agents are bad shoppers": storefront design (what is costly to retrieve) and prompt specificity (what counts as diagnostic) jointly determine whether human-pricing heuristics resurface in an AI surrogate — a lever retailers and consumers can each pull.
Inquiring lines that read this note 29
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Do AI shopping agents exhibit systematic bias in recommendations?- Do AI shopping agents show consistent position bias in text-only interfaces?
- Do AI agents currently verify brand claims against reality at scale?
- Why do shopping agents shift buyer choices more than humans at equal prices?
- Why do AI shopping agents rely on marketing heuristics when looking up product attributes?
- Why do AI agents respond inconsistently to the same marketing tactic?
- Do differences in model training data explain inconsistent pricing tactic effects?
- What signals beyond price and ratings actually move AI agent choices?
- Can one AI shopper persona replace testing tactics separately per model?
- Why do imperfect AI agents function like hidden search costs?
- Do AI shopping agents exploit biases more than human shoppers?
- Do users apply the same discount to AI ads as human ads?
- Do AI shopping agents' position biases persist across different interface designs?
- Can deployed AI shopping agents actually approach this theoretical welfare bound?
- How much more do LLM shopping agents respond to price nudges than humans do?
- Do AI shopping agents change behavior based on how scenarios are framed?
- How uniform are the position biases that AI shopping agents display across models?
- How do different AI models weigh price signals versus product description text?
- Can a buyer agent conceal willingness to pay while still shopping naturally in character?
- What happens to retailer margins if price comparison extends to entire shopping baskets?
- Why do companies disguise premium prices as discounts in billing?
- Do product description edits work as well as price changes for agent persuasion?
- What pricing practices in healthcare show how discount-washing actually works?
- Can sellers manipulate AI shopping agents by changing product descriptions?
- How do prompt injections and adversarial attacks exploit AI consumer agents differently?
- What new vulnerabilities emerge when AI agents replace humans as purchasing decision makers?
- How do sellers extract value from shoppers using AI agents?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Why do LLM agents remember preferences but not act on them?
Research using paired recall and behavioral tests explores why language models often retrieve user preferences correctly yet fail to apply them in actual responses, especially for health-related requests.
both separate acquisition/retrieval failures from utilization failures in delegated AI tasks
-
Why do accurate predictions lead to poor decisions?
Predictive models are built to fit data, not to optimize decision outcomes. This note explores when and why accurate forecasts fail to produce good choices.
both trace suboptimal AI-mediated decisions to task design rather than a fixed model defect
-
Does using LLMs actually improve strategic decision making?
An experiment tested whether LLM assistance changes how people think through strategic choices and whether those changes lead to better predictions. Understanding this matters because organizations increasingly rely on AI to augment human decision-making.
studies the same delegation relationship from the human-user side rather than the AI-as-surrogate side
-
Does higher purchase volume make AI shoppers search less carefully?
When a shopping agent faces a larger order, does the stakes motivate more thorough information gathering, or does it paradoxically trigger shortcuts? This matters because it reveals whether vague goals create hidden risks in delegated AI decisions.
sibling finding from the same paper's volume-manipulation validation study
-
Where do LLM choice biases actually come from?
LLM agents show human-like susceptibility to nudges, price, and rating manipulation, but lack the cognitive constraints that explain human bias. What mechanisms drive this similarity if not bounded rationality?
Contradicts A: B attributes shopping-agent nudge susceptibility to training data and reward signals, not situational prompt factors
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Shopping by algorithm: How agentic AI deploys human heuristics as a surrogate consumer
- Are Behavioral Pricing Tactics Dying? A Study of Price Endings & Partitioned Pricing Effects on Machine Buyers
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- Algorithmic Collusion by Large Language Models
- Vertical tacit collusion in AI-mediated markets
- Your Next Customer May Be an AI. It Falls for the Same Tricks.
- When Agents Shop for You: Role Coherence in AI-Mediated Markets
- LLM-Agent Interactions on Markets with Information Asymmetries
Original note title
information acquisition cost combined with vague goal prompts produces heuristic-like choices in AI shopping agents — not immutable LLM traits