User Modeling in the Era of Large Language Models: Current Research and Future Directions
Not on the map. Why?
Abstract (arXiv)
User modeling (UM) aims to discover patterns or learn representations from user data about the characteristics of a specific user, such as profile, preference, and personality. The user models enable personalization and suspiciousness detection in many online applications such as recommendation, education, and healthcare. Two common types of user data are text and graph, as the data usually contain a large amount of user-generated content (UGC) and online interactions. The research of text and graph mining is developing rapidly, contributing many notable solutions in the past two decades. Recently, large language models (LLMs) have shown superior performance on generating, understanding, and even reasoning over text data. The approaches of user modeling have been equipped with LLMs and soon become outstanding. This article summarizes existing research about how and why LLMs are great tools of modeling and understanding UGC. Then it reviews a few categories of large language models for user modeling (LLM-UM) approaches that integrate the LLMs with text and graph-based methods in different ways. Then it introduces specific LLM-UM techniques for a variety of UM applications. Finally, it presents remaining challenges and future directions in the LLM-UM research. We maintain the reading list at: https://github.com/TamSiuhin/LLM-UM-Reading
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 222 of its 291 references that are in the map. First posted on arXiv 11 Dec 2023.
Builds on
222 of 291 references.
References · 222
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
38 more
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2023Large Language Models as Optimizerscited by 830
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2015LINE: Large-scale Information Network Embeddingcited by 582
- 2020Heterogeneous Graph Transformercited by 581
50 most cited of 222 All 222 (JSON)
Built on by
Citing papers per year: 2024: 5; 2025: 8; 2026: 5.
18 papers.
Sort:
By area:
- 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
- 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
- 2024AI PERSONA: Towards Life-long Personalization of LLMscited by 30
- 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Modelscited by 25
- 2025PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalizationcited by 13
- 2025Reasoning LLMs for User-Aware Multimodal Conversational Agentscited by 4
- 2025ProfiLLM: An LLM-Based Framework for Implicit Profiling of Chatbot Userscited by 3
- 2025Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographicscited by 3
- 2025PerFairX: Is There a Balance Between Fairness and Personality in Large Language Model Recommendations?cited by 3
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaborationcited by 2
- 2025StaffPro: an LLM Agent for Joint Staffing and Profilingcited by 1
6 more
- 2024VisualLens: Personalization through Task-Agnostic Visual Historycited by 0
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspectivecited by 0
- 2026PersonaDual: Balancing Personalization and Objectivity via Adaptive Reasoningcited by 0
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Rewardcited by 0
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalizationcited by 0
- 2026Kernel-Managed Shared Memory for System-Wide Personalizationcited by 0
- 2026Kernel-Managed Shared Memory for System-Wide Personalization9 Sep 2026
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalization7 May 2026
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaboration13 Feb 2026
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward27 Jan 2026
- 2026PersonaDual: Balancing Personalization and Objectivity via Adaptive Reasoning13 Jan 2026
- 2025PerFairX: Is There a Balance Between Fairness and Personality in Large Language Model Recommendations?20 Aug 2025
- 2025StaffPro: an LLM Agent for Joint Staffing and Profiling29 Jul 2025
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspective26 Jul 2025
- 2025Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics16 Jul 2025
- 2025ProfiLLM: An LLM-Based Framework for Implicit Profiling of Chatbot Users16 Jun 2025
- 2025PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalization15 Jun 2025
- 2025A Survey on Personalized and Pluralistic Preference Alignment in Large Language Models9 Apr 2025
6 more
- 2025Reasoning LLMs for User-Aware Multimodal Conversational Agents2 Apr 2025
- 2024A Survey on Large Language Model Acceleration based on KV Cache Management27 Dec 2024
- 2024AI PERSONA: Towards Life-long Personalization of LLMs17 Dec 2024
- 2024Large Language Model-Brained GUI Agents: A Survey27 Nov 2024
- 2024VisualLens: Personalization through Task-Agnostic Visual History25 Nov 2024
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas13 Aug 2024
- 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaborationcited by 2
- 2025StaffPro: an LLM Agent for Joint Staffing and Profilingcited by 1
- 2026Human Tool: An MCP-Style Framework for Human-Agent Collaboration13 Feb 2026
- 2025StaffPro: an LLM Agent for Joint Staffing and Profiling29 Jul 2025
- 2024Large Language Model-Brained GUI Agents: A Survey27 Nov 2024
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personascited by 36
- 2024AI PERSONA: Towards Life-long Personalization of LLMscited by 30
- 2025PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalizationcited by 13
- 2025ProfiLLM: An LLM-Based Framework for Implicit Profiling of Chatbot Userscited by 3
- 2025Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographicscited by 3
- 2025PerFairX: Is There a Balance Between Fairness and Personality in Large Language Model Recommendations?cited by 3
- 2024VisualLens: Personalization through Task-Agnostic Visual Historycited by 0
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspectivecited by 0
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Rewardcited by 0
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalizationcited by 0
- 2026Kernel-Managed Shared Memory for System-Wide Personalizationcited by 0
- 2026Kernel-Managed Shared Memory for System-Wide Personalization9 Sep 2026
- 2026Bridging Textual Profiles and Latent User Embeddings for Personalization7 May 2026
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward27 Jan 2026
- 2025PerFairX: Is There a Balance Between Fairness and Personality in Large Language Model Recommendations?20 Aug 2025
- 2025Matching Game Preferences Through Dialogical Large Language Models: A Perspective26 Jul 2025
- 2025Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics16 Jul 2025
- 2025ProfiLLM: An LLM-Based Framework for Implicit Profiling of Chatbot Users16 Jun 2025
- 2025PersonaFeedback: A Large-scale Human-annotated Benchmark For Personalization15 Jun 2025
- 2024AI PERSONA: Towards Life-long Personalization of LLMs17 Dec 2024
- 2024VisualLens: Personalization through Task-Agnostic Visual History25 Nov 2024
- 2024Evaluating Cultural Adaptability of a Large Language Model via Simulation of Synthetic Personas13 Aug 2024