Can LLMs predict character choices from narrative context?
Explores whether language models can predict fictional character decisions when given rich personality profiles and retrieved narrative memories. This tests whether LLMs can model complex human motivation grounded in literary analysis.
Can LLMs predict how fictional characters will act at pivotal moments? The Character is Destiny paper (2024) constructs LIFECHOICE — a benchmark of 1,462 decision points from 388 novels, leveraging expert character analyses from literary scholars. The task: given the preceding narrative, predict which choice the character makes.
The architecture decomposes into two components. First, a character profile combining a static description (personality, experiences, values) with retrieved memories — specific passages from the preceding text. Second, a reasoning step using the profile to answer the decision question.
Three methods for constructing descriptions reveal a hierarchy: expert-written descriptions (from Supersummary) outperform both hierarchical merging (summarize chunks, merge summaries iteratively) and incremental updating (summarize sequentially, refine). This suggests that literary expertise captures something about character motivation — the relationship between personality, values, and action — that automated summarization misses.
The CHARMAP method adds persona-based memory retrieval: selecting narrative passages relevant to the character's psychological profile rather than just the decision context. This yields a 5.03% accuracy gain, indicating that who the character is determines which memories matter for predicting what they will do.
Character-driven motivations decompose into: personality and traits, emotions and psychological state, social relationships, values and beliefs, and desires and goals. This taxonomy suggests that persona simulation for decision-making requires richer internal models than the demographic + preference approaches used in most LLM persona work.
The connection to Why do LLMs fail to act on their stated beliefs? is instructive: when beliefs are extracted from rich narrative context rather than assigned through brief prompts, behavioral prediction improves.
Inquiring lines that read this note 26
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What makes personas effective for predicting individual preferences and behavior?- What narrative elements trigger emotional connection that structured personas lack?
- Can persona profiles be enriched to constrain LLM predictions and reduce run-to-run variance?
- Can demographic personas predict behavior without rich narrative grounding?
- What specific character traits drive memory selection in persona-based retrieval?
- Do stated character beliefs predict decisions better when extracted from text?
- Does richer input to LLM personas improve their fidelity to human responses?
- Why do language models successfully simulate political perspectives and social personas?
- Why does persona roleplay framing introduce systematic bias in model predictions?
- How do bimodal decision patterns in LLMs compare to human economic choice?
- Can LLM therapists develop character knowledge to decide when advice-giving fits?
- Why does expert character analysis outperform automated narrative summarization?
- What specific narrative features best distinguish AI from human fiction?
- How do authors decide which story components must stay under human control?
- Can general chatbot skill predict how well models roleplay adversarial personas?
- Can dynamic personality modeling without event-specificity produce plausible dialogue?
- Do characters shift their beliefs and relationships based on specific story events?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?
- EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary World
- Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization
- H2HTalk: Evaluating Large Language Models as Emotional Companion
- Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
- Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
- From Five Dimensions to Many: Large Language Models as Precise and Interpretable Psychological Profilers
- Too Good to be Bad: On the Failure of LLMs to Role-Play Villains
Original note title
persona-driven memory retrieval from narrative text enables LLMs to predict character decisions — expert-written descriptions plus embedding retrieval outperform hierarchical summarization