Can LLMs predict character choices from narrative context?
Explores whether language models can predict fictional character decisions when given rich personality profiles and retrieved narrative memories. This tests whether LLMs can model complex human motivation grounded in literary analysis.
Can LLMs predict how fictional characters will act at pivotal moments? The Character is Destiny paper (2024) constructs LIFECHOICE — a benchmark of 1,462 decision points from 388 novels, leveraging expert character analyses from literary scholars. The task: given the preceding narrative, predict which choice the character makes.
The architecture decomposes into two components. First, a character profile combining a static description (personality, experiences, values) with retrieved memories — specific passages from the preceding text. Second, a reasoning step using the profile to answer the decision question.
Three methods for constructing descriptions reveal a hierarchy: expert-written descriptions (from Supersummary) outperform both hierarchical merging (summarize chunks, merge summaries iteratively) and incremental updating (summarize sequentially, refine). This suggests that literary expertise captures something about character motivation — the relationship between personality, values, and action — that automated summarization misses.
The CHARMAP method adds persona-based memory retrieval: selecting narrative passages relevant to the character's psychological profile rather than just the decision context. This yields a 5.03% accuracy gain, indicating that who the character is determines which memories matter for predicting what they will do.
Character-driven motivations decompose into: personality and traits, emotions and psychological state, social relationships, values and beliefs, and desires and goals. This taxonomy suggests that persona simulation for decision-making requires richer internal models than the demographic + preference approaches used in most LLM persona work.
The connection to Why don't LLM role-playing agents act on their stated beliefs? is instructive: when beliefs are extracted from rich narrative context rather than assigned through brief prompts, behavioral prediction improves.
Inquiring lines that use this note as a source 20
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- What narrative elements trigger emotional connection that structured personas lack?
- Why do language models successfully simulate political perspectives and social personas?
- How do LLMs identify which personality items matter most for trait inference?
- What does the 20-questions test reveal about LLM character consistency?
- Can LLMs infer psychological profiles without explicit user disclosure?
- How do bimodal decision patterns in LLMs compare to human economic choice?
- Can persona profiles be enriched to constrain LLM predictions and reduce run-to-run variance?
- Can LLM therapists develop character knowledge to decide when advice-giving fits?
- Why does expert character analysis outperform automated narrative summarization?
- Can demographic personas predict behavior without rich narrative grounding?
- What specific character traits drive memory selection in persona-based retrieval?
- Do stated character beliefs predict decisions better when extracted from text?
- Can general chatbot skill predict how well models roleplay adversarial personas?
- How do LLMs compress literary language without losing essential nuance?
- Can prompted or fine-tuned models generate genuine narrative ambiguity?
- What specific narrative features best distinguish AI from human fiction?
- Why do different language models converge on similar narrative defaults?
- How do entity graphs connect faces, voices, and preferences across modalities?
- How do hierarchical knowledge layers capture different types of narrative information?
- Does richer input to LLM personas improve their fidelity to human responses?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?
- Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization
- H2HTalk: Evaluating Large Language Models as Emotional Companion
- From Five Dimensions to Many: Large Language Models as Precise and Interpretable Psychological Profilers
- Too Good to be Bad: On the Failure of LLMs to Role-Play Villains
- PersLLM: A Personified Training Approach for Large Language Models
- Thinking in Character: Advancing Role-Playing Agents with Role-Aware Reasoning
- PersonaGym: Evaluating Persona Agents and LLMs
Original note title
persona-driven memory retrieval from narrative text enables LLMs to predict character decisions — expert-written descriptions plus embedding retrieval outperform hierarchical summarization