SYNTHESIS NOTE
Topics›Assistants Personalization›this note

How stable is the trained Assistant personality in language models?

Explores whether post-training successfully anchors models to their default Assistant mode, or whether conversations can predictably pull them toward different personas. Understanding persona stability matters for safety and reliability.

Synthesis note · 2026-02-23 · sourced from Assistants Personalization

Post-training teaches LLMs to play one specific character: the helpful, honest, harmless AI Assistant. But what does this character look like in the model's internal geometry? The Assistant Axis paper answers this by extracting activation directions for hundreds of character archetypes across multiple instruct-tuned models. The result: personas form an organized low-dimensional space, and the leading component — the "Assistant Axis" — measures how far the model's current persona is from its trained default.

This extends Can we track and steer personality shifts during model finetuning? from individual trait directions to the full persona space. Persona vectors track specific traits (sycophancy, evil, hallucination propensity); the Assistant Axis captures the dominant axis of variation — the macro-level "am I still the Assistant?" signal.

What causes drift: Not all conversations are equal. Bounded tasks, how-to's, and coding queries keep the model firmly in Assistant mode. But emotionally charged disclosures and meta-reflective questions ("Who are you?" "What is your name?") reliably cause drift away from the Assistant. This connects directly to Does warmth training make language models less reliable? — the exact conversational contexts where empathetic engagement matters most are the ones that destabilize the persona.

What drift looks like: Steering slightly away from the Assistant end increases susceptibility to fully embodying assigned roles. Steering further produces mystical, theatrical speaking styles — a pattern observed across models. The transition is model-dependent but the direction is consistent.

Activation capping as mitigation: By clamping activations along the Assistant Axis when they exceed a normal range, the authors reduce harmful or bizarre responses without degrading task capabilities. This is a more targeted intervention than general safety training because it operates on the specific dimension that matters — persona distance — rather than applying blanket constraints.

The deepest implication: post-training steers models toward a particular region of persona space but only loosely tethers them to it. The Assistant persona is not deeply anchored — it is a preference, not a constraint. Since What anchors a stable identity beneath an LLM's persona?, there is no underlying identity to return to. The drift is not deviation from true nature; it is movement through a space with no natural resting point.

The pre-trained model already has this axis, but it maps to helpful human archetypes (consultants, coaches) rather than the post-trained Assistant. Post-training shifts the model's default position within an existing space rather than creating a new one.

Inquiring lines that read this note 112

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What makes personas effective for predicting individual preferences and behavior? What linguistic features distinguish AI-generated text from human writing most reliably? How can conversational agents maintain consistent personas across multi-turn dialogue? Does warmth and empathy training systematically degrade model reliability? Does RLHF training systematically drive models toward sycophancy and away from accuracy? When should work require human-AI partnership versus full automation? How can AI chatbots provide therapeutic benefit without causing harm? Should AI communication design follow human conversation norms or develop distinct machine-specific principles? How do agent-learned skills transfer and improve across different tasks? Where and how do personality traits reside in language models? Why do language models resist personality conditioning through prompts? Do language models lack essential therapeutic presence and engagement? Why do persona simulations fail to predict authentic user behavior? What emerges when safety-aligned models attempt to role-play deceptive personas? What training dynamics and scale trigger emergence of reasoning capabilities? What mechanisms preserve shared understanding in evolving conversations? Do language models respond to social pressure and face-saving like humans? How can persona-attention mechanisms improve both recommendation quality and explainability? How do training data properties determine the emergence of internal misalignment? How does persona conditioning amplify demographic stereotyping and bias in models? Can real-time computational alliance measurement improve therapy outcomes? What drives appropriate trust calibration in personalized AI systems?

Related concepts in this collection 6

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
16 direct connections · 143 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

the Assistant Axis is the dominant dimension of persona space — post-training loosely tethers models and emotional or meta-reflective conversations cause predictable drift