Will AI automation eventually formalize designer taste?
Designers argue taste is the irreducible human element AI cannot replicate. But does the same automation pattern that formalized other skilled work suggest taste itself will become the next layer to be encoded into evaluation systems?
Designers under pressure from AI automation often retreat to taste as the protected core of their work. AI can produce layouts, generate variations, draft copy, even prototype interactions — but it cannot have taste. Taste is judgment shaped by lived experience, by years of seeing what works and what does not, by an intuition no training distribution can produce. Therefore (the argument runs) the human designer remains essential as the holder of taste even as execution is automated.
The argument inherits a structural pattern from prior automation waves and predicts the same outcome. Each wave begins with practitioners identifying a core capacity that "machines cannot replicate." Each wave proceeds by formalizing that capacity into a process that machines can then execute. The capacity is not preserved as the protected core; it is converted into the next layer of work to be automated.
For taste specifically, the formalization mechanism is already visible: evals. AI workflows increasingly require evaluation infrastructure to assess output quality. Designers who want to retain influence over AI design output will do so by writing the evals — encoding their taste into criteria, examples, rubrics, and preference data that the AI uses to score and improve its output. The taste does not stay in the designer; it migrates into the eval, and the eval is then applied automatically. The reification is what allows the taste to scale; the scaling is what makes the human-with-taste optional.
This is not a critique of designers writing evals — they should, because writing evals is how their judgment continues to shape outcomes. It is a correction to the argument that taste is the protected core. Taste is the next thing to be formalized, not the thing that resists formalization. The designers who survive the next wave are not the ones whose taste cannot be encoded; they are the ones whose taste is the most worth encoding, who get to write the evals everyone else's AI uses. The position changes from in-the-loop executor to out-of-the-loop authority — fewer roles, more leverage, and a different kind of work.
The diagnostic implication: claims that "AI cannot have X, therefore X is the protected human role" should be read as descriptions of the next layer of automation rather than as defenses of human work. The taste argument is structurally identical to "AI cannot drive cars" or "AI cannot diagnose disease" arguments from prior decades, and will likely follow the same trajectory.
The strongest counterargument: some forms of taste are too contextual to formalize — the designer's judgment about a specific client, a specific brief, a specific moment. True for the most contextual work, but most professional-design work is calibrated to genres and conventions whose taste is precisely the kind that formalizes. The formalization does not need to capture all taste; it needs to capture enough taste to handle the high-volume cases. The contextual remainder shrinks as the formalization improves.
Inquiring lines that use this note as a source 1
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does polished AI output trick audiences into trusting it?
When AI generates professional-looking graphs, diagrams, and presentations, do audiences mistake visual polish for analytical depth? This matters because appearance might substitute for actual expertise.
companion claim about how the surface markers of taste get reproduced
-
Is expertise really just knowing more than others?
This explores whether expertise is fundamentally about possessing domain knowledge, or whether the ability to deploy that knowledge in the right moment, context, and way with the right audience is equally or more central to what makes someone an expert.
adjacent claim about what aspects of expertise resist formalization
-
Should interactive evaluation be designed as a unified paradigm?
As AI systems increasingly interact over time with tools and environments, evaluation practice must evolve. Should interactive evaluation be treated as a principled design science with shared protocols, or adopted incrementally as new benchmarks?
synthesizes: both treat evaluation design itself as the contested formalizable layer, here as a principled paradigm rather than ad hoc benchmark collection
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- AI Can Learn Scientific Taste
- Mathematical methods and human thought in the age of AI
- Interactive Evaluation Requires a Design Science
- Position: LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks
- Disambiguating Anthropomorphism and Anthropomimesis in Human-Robot Interaction
- Has the Creativity of Large-Language Models peaked? —an analysis of inter- and intra-LLM variability —
- Machine ex machina: A Framework Decentering the Human in AI Design Praxis
- Beyond Preferences in AI Alignment
Original note title
designer taste will be reified into evals — the supposedly irreducible human element becomes another AI process