Transparent and Controllable Recommendation Filtering via Multimodal Multi-Agent Collaboration
On the map: LLM agents and tool use → Agentic recommender systems
Abstract (arXiv)
While personalized recommender systems excel at content discovery, they frequently expose users to undesirable or discomforting information, highlighting the critical need for user-centric filtering tools. Current methods leveraging Large Language Models (LLMs) struggle with two major bottlenecks: they lack multimodal awareness to identify visually inappropriate content, and they are highly prone to "over-association" -- incorrectly generalizing a user's specific dislike (e.g., anxiety-inducing marketing) to block benign, educational materials. These unconstrained hallucinations lead to a high volume of false positives, ultimately undermining user agency. To overcome these challenges, we introduce a novel framework that integrates end-to-cloud collaboration, multimodal perception, and multi-agent orchestration. Our system employs a fact-grounded adjudication pipeline to eliminate inferential hallucinations. Furthermore, it constructs a dynamic, two-tier preference graph that allows for explicit, human-in-the-loop modifications (via Delta-adjustments), explicitly preventing the algorithm from catastrophically forgetting fine-grained user intents. Evaluated on an adversarial dataset comprising 473 highly confusing samples, the proposed architecture effectively curbed over-association, decreasing the false positive rate by 74.3% and achieving nearly twice the F1-Score of traditional text-only baselines. Additionally, a 7-day longitudinal field study with 19 participants demonstrated robust intent alignment and enhanced governance efficiency. User feedback confirmed that the framework drastically improves algorithmic transparency, rebuilds user control, and alleviates the fear of missing out (FOMO), paving the way for transparent human-AI co-governance in personalized feeds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agentic recommender systems, one of 16 directions in LLM agents and tool use. Builds on 13 of its 39 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
13 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
- 2017How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utilitycited by 120
- 2024On-Device Language Models: A Comprehensive Reviewcited by 104
- 2021What are you optimizing for? Aligning Recommender Systems with Human Valuescited by 29
- 2022User-controllable Recommendation Against Filter Bubblescited by 22
- 2023Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Laborcited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Agents as Knowledge Integrator and Utilizer in Multimodal Recommendation
- 2025Generate, Not Recommend: Personalized Multimodal Content Generation
- 2026Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testing
- 2025Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanations
- 2025Causal Inspired Multi Modal Recommendation
- 2026Can We Steer the Black-Box? Towards Controllability-Centric Evaluation of Recommender Systems with Collaborative Agents
- 2026Do Recommendation Algorithms Work When Users Are LLM Agents? A Case Study on Moltbook
- 2025Multi-Agent Collaborative Filtering: Orchestrating Users and Items for Agentic Recommendations