Can imaginary listeners reduce dialogue agent contradictions?
Does simulating how an imaginary listener would interpret an utterance help dialogue agents maintain persona consistency without extra training? This explores whether pragmatic self-monitoring at generation time can replace costly supervised approaches.
Persona-based dialogue agents routinely contradict their own stated attributes. Previous solutions either require Natural Language Inference (NLI) labels for training or attach extra trained modules. The "Will I Sound Like Me?" approach (2020) takes a different path: it endows existing agents with public self-consciousness at inference time through an imaginary listener, inspired by social cognition and pragmatics.
The mechanism uses the Rational Speech Acts (RSA) framework. Before generating an utterance, the agent simulates how a listener would interpret it — specifically, whether the listener could distinguish this speaker's persona from a distractor persona based on the utterance. Utterances that would not help identify the speaker (because they are generic or contradictory) are suppressed. The agent learns to ask: "Would I sound like me if I said this?"
The framework extends beyond persona to context consistency in general dialogue. The distractor selection — which alternative persona to contrast against — can be learned rather than manual or random.
This connects to Why does supervised learning fail to enforce persona consistency? as a complementary approach: offline RL punishes contradiction during training while RSA prevents it during inference. The RSA approach requires no additional training data but operates at generation time, adding computational cost per utterance. The trade-off is training-time correction vs. inference-time self-monitoring — both address the same root cause that generative models are never explicitly rewarded for consistency.
The deeper insight is that persona consistency is fundamentally a pragmatic property, not a semantic one. It is about how utterances function in identifying a speaker, not just about logical compatibility of facts.
Inquiring lines that read this note 36
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What makes personas effective for predicting individual preferences and behavior?- At what scale does persona distortion become a threat to public discourse?
- Can synthetic personas achieve emotional connection with creators?
- How should persona prompts be used if not for accuracy?
- How does behavioral stickiness distinguish realized from pretended personas?
- How does persona consistency affect coherence in simulated dialogue?
- Do synthetic personas maintain consistency across multiple conversations?
- How does Shanahan's simulator model explain first-person pronoun consistency in dialogue agents?
- Can offline reinforcement learning teach models to avoid persona contradictions?
- What training objectives would actually improve persona consistency at scale?
- How can training methods enforce persona consistency without supervised learning penalizing it?
- Can persona consistency coexist with relevant dialogue in personalized conversation?
- How does distractor persona selection affect consistency enforcement in dialogue?
- Why is persona consistency a pragmatic property rather than semantic?
- What downstream consequences follow if dialogue agent personas are realized?
- Can treating simulated users as trainable agents reduce persona consistency drift?
- Does persona assignment alone produce repetitive dialogue without situational grounding?
- How do persona and context multiply to improve synthetic dialogue diversity?
- How do persona consistency and contextual relevance trade off in personalized dialogue systems?
- Does explicit inconsistency detection improve persona consistency in multi-turn dialogue?
- How much dialog context is needed to accurately bind pretrained models to individual personas?
- Can human-like personas deceive users about artificial nature during interactions?
- What psychological instruments best measure persona consistency in clinical simulation dialogue?
- Do dialogue agents have authentic voice agency or beliefs of their own?
- Can dialogue agents be reliable but still feel inflexible or cold?
- How do contextual characteristics like emotional state shape dialogue authenticity?
- Can a virtual instance be individuated from its conversational context?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- From Persona to Person: Enhancing the Naturalness with Multiple Discourse Relations Graph Learning in Personalized Dialogue Generation
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models
- Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
- The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
- Building Persona Consistent Dialogue Agents with Offline Reinforcement Learning
- WHEN TO ACT, WHEN TO WAIT: Modeling Structural Trajectories for Intent Triggerability in Task-Oriented Dialogue
Original note title
pragmatic self-consciousness through an imaginary listener reduces persona contradiction without additional training — Rational Speech Acts framework enforces consistency by simulating how utterances would be interpreted