SYNTHESIS NOTE
Topics›Design Frameworks›this note

Can language models discover what users actually want from activity logs?

Users pursue month-long interest journeys that transcend individual item clicks. Can LLMs extract these persistent goals from behavioral patterns, and does this change how we should think about personalization?

Synthesis note · 2026-02-23 · sourced from Design Frameworks

Recommender systems predict the next item a user might click on, given their history. But when you ask users what they're actually doing on the platform, they describe something different: persistent, overarching interests — "designing hydroponic systems for small spaces," "learning the ukulele as a beginner," "cooking Italian recipes." These are interest journeys, and they operate at a completely different level of abstraction from next-item prediction.

Survey data shows 66% of respondents recently pursued a valued journey on the platform. Of those, 80% consumed relevant content for more than a month, with half saying some journeys last more than a year. People pursue 1-3 journeys simultaneously.

The semantic gap is real: collaborative filtering captures correlational patterns between items ("people who watched X also watched Y") but cannot reason about the user's underlying goal, need, or interest. Two users both interested in stand-up comedy may pursue completely different aspects — history documentaries vs. SNL skits. The journey is personalized at a granularity collaborative filtering cannot reach.

LLMs can bridge this gap. Through personalized clustering of user activity logs followed by LLM-powered journey naming, the system produces journey descriptions users identify with. But specificity matters — "greenhouse designs for cold climates" was irrelevant for someone pursuing indoor gardening. The right level of abstraction is what the user would actually say to a friend asking about their interests.

This connects to How do personalization granularity levels trade precision against scalability? — interest journeys operate at the user level but require persona-level precision. Since Does chatbot personalization build trust or expose privacy risks?, journey-aware systems that understand your persistent interests will trigger both the trust and privacy dimensions of this dual dynamic.

Inquiring lines that read this note 33

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How do recommenders balance exploiting fresh signals against maintaining preference stability? Can preference-based training achieve better behavior optimization than supervised fine-tuning alone? Do structural constraints outperform deep architectures in recommendation systems? How do evaluation practices shape which failures stay visible? Do knowledge graphs offer advantages over embeddings for multi-hop retrieval? Does abstract user knowledge outperform concrete interaction history in personalization? What prevents conversational agents from taking initiative in dialogue? What drives appropriate trust calibration in personalized AI systems? How can persona-attention mechanisms improve both recommendation quality and explainability? How does persona conditioning amplify demographic stereotyping and bias in models? What determines appropriate intervention timing and manner for AI agents? Can language models build genuine grounding through interaction? What enables genuine semantic understanding in language models? Why do some clarifying approaches produce understanding while others just satisfy?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
14 direct connections · 107 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

LLMs can discover and describe persistent user interest journeys from activity patterns but recommender systems predict next items instead