CTRL-Rec: Controlling Recommender Systems With Natural Language
Not on the map. Why?
Abstract (arXiv)
When users are dissatisfied with recommendations from a recommender system, they often lack fine-grained controls for changing them. Large language models (LLMs) offer a solution by allowing users to guide their recommendations through natural language requests (e.g., "I want to see respectful posts with a different perspective than mine"). We propose a method, CTRL-Rec, that allows for natural language control of traditional recommender systems in real-time with computational efficiency. Specifically, at training time, we use an LLM to simulate whether users would approve of items based on their language requests, and we train embedding models that approximate such simulated judgments. We then integrate these user-request-based predictions into the standard weighting of signals that traditional recommender systems optimize. At deployment time, we require only a single LLM embedding computation per user request, allowing for real-time control of recommendations. In experiments with the MovieLens dataset, our method consistently allows for fine-grained control across a diversity of requests. In a study with 19 Letterboxd users, we find that CTRL-Rec was positively received by users and significantly enhanced users' sense of control and satisfaction with recommendations compared to traditional controls.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 39 of its 68 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
39 of 68 references.
References · 39
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2023A Survey on Large Language Models for Recommendationcited by 379
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
- 2020Distilling Knowledge from Reader to Retriever for Question Answeringcited by 226
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2023How Can Recommender Systems Benefit from Large Language Models: A Surveycited by 142
- 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferencescited by 66
- 2023Leveraging Large Language Models in Conversational Recommender Systemscited by 63
- 2022InPars: Data Augmentation for Information Retrieval using Large Language Modelscited by 62
- 2023How Does Generative Retrieval Scale to Millions of Passages?cited by 48
27 more
- 2024On Targeted Manipulation and Deception when Optimizing LLMs for User Feedbackcited by 47
- 2023Large Language Model Augmented Narrative Driven Recommendationscited by 31
- 2023Engagement, User Satisfaction, and the Amplification of Divisive Content on Social Mediacited by 30
- 2022The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimizationcited by 29
- 2024Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyondcited by 26
- 2023Embedding Democratic Values into Social Media AIs via Societal Objective Functionscited by 25
- 2024Transparent and Scrutable Recommendations Using Natural Language User Profilescited by 24
- 2022On Natural Language User Profiles for Transparent and Scrutable Recommendationcited by 23
- 2024Review-driven Personalized Preference Reasoning with Large Language Models for Recommendationcited by 22
- 2019Recommendations and User Agency: The Reachability of Collaboratively-Filtered Informationcited by 21
- 2020From Optimizing Engagement to Measuring Valuecited by 21
- 2023Editable User Profiles for Controllable Text Recommendationcited by 16
- 2021How the Design of YouTube Influences User Sense of Agencycited by 12
- 2020Microsoft Recommenders: Tools to Accelerate Developing Recommender Systemscited by 10
- 2024End-to-end Training for Recommendation with Language-based User Profilescited by 10
- 2021Quantifying Availability and Discovery in Recommender Systems via Stochastic Reachabilitycited by 8
- 2023Choosing the Right Weights: Balancing Value, Strategy, and Noise in Recommender Systemscited by 7
- 2024Foundation Models for Recommender Systems: A Survey and New Perspectivescited by 7
- 2024Reranking partisan animosity in algorithmic social media feeds alters affective polarizationcited by 7
- 2024What We Know About Using Non-Engagement Signals in Content Rankingcited by 6
- 2024Preference Discerning with LLM-Enhanced Generative Retrievalcited by 6
- 2024Mapping the Design Space of Teachable Social Media Feed Experiencescited by 5
- 2024TEARS: Textual Representations for Scrutable Recommendationscited by 5
- 2025Alexandria: A Library of Pluralistic Values for Realtime Re-Ranking of Social Media Feedscited by 5
- 2025Value Alignment of Social Media Ranking Algorithmscited by 4
- 2024PairDistill: Pairwise Relevance Distillation for Dense Retrievalcited by 3
- 2024System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processescited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Agentic Recommender System with Hierarchical Belief-State Memorycited by 5
- 2026LLM-Assisted Reranking to Operationalize Nuanced Objectives in Recommender Systemscited by 0
- 2026Compass: Continuously Aligning Social Media Feeds via In-Situ Reflectionscited by 0
- 2026Dear Algo: A Precision-First Agentic Intent Layer for Unified Search and Recommendationcited by 0
- 2026Dear Algo: A Precision-First Agentic Intent Layer for Unified Search and Recommendation16 Aug 2026
- 2026Compass: Continuously Aligning Social Media Feeds via In-Situ Reflections4 Aug 2026
- 2026LLM-Assisted Reranking to Operationalize Nuanced Objectives in Recommender Systems1 Jun 2026
- 2026Agentic Recommender System with Hierarchical Belief-State Memory14 May 2026