mlsanityData to 7 Oct 2026

Lightweight Fairness for LLM-Based Recommendations via Kernelized Projection and Gated Adapters

arXiv 2603.23780 ↗First posted 24 Mar 2026cs.LGcited by 1

On the map: Mixture-of-experts → MoE for recommender systems

Abstract (arXiv)

Large Language Models (LLMs) have introduced new capabilities to recommender systems, enabling dynamic, context-aware, and conversational recommendations. However, LLM-based recommender systems inherit and may amplify social biases embedded in their pre-training data, especially when demographic cues are present. Existing fairness solutions either require extra parameters fine-tuning, or suffer from optimization instability. We propose a lightweight and scalable bias mitigation method that combines a kernelized Iterative Null-space Projection (INLP) with a gated Mixture-of-Experts (MoE) adapter. Our approach estimates a closed-form projection that removes single or multiple sensitive attributes from LLM representations with no additional trainable parameters. To preserve task utility, we introduce a two-level MoE adapter that selectively restores useful signals without reintroducing bias. Experiments on two public datasets show that our method reduces attribute leakage across multiple protected variables while maintaining competitive recommendation accuracy.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MoE for recommender systems, one of 12 directions in Mixture-of-experts. Builds on 23 of its 34 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

23 of 34 references.

References · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  3. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  4. 2017Counterfactual Fairnesscited by 802
  5. 2023Bias and Fairness in Large Language Models: A Surveycited by 626
  6. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 442
  7. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  8. 2020Fairness in Machine Learning: A Surveycited by 369
  9. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  10. 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 241
  11. 2023Recommender Systems in the Era of Large Language Models (LLMs)cited by 188
  12. 2023Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendationcited by 113
11 more
  1. 2023CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendationcited by 99
  2. 2022Linear Adversarial Concept Erasurecited by 98
  3. 2023UP5: Unbiased Foundation Model for Fairness-aware Recommendationcited by 38
  4. 2024Item-side Fairness of Large Language Model-based Recommendation Systemcited by 21
  5. 2024CFaiRLLM: Consumer Fairness Evaluation in Large-Language Model Recommender Systemcited by 18
  6. 2022Selective Fairness in Recommendation via Promptscited by 16
  7. 2024RecGPT: Generative Pre-training for Text-based Recommendationcited by 9
  8. 2025On the Importance of Gaussianizing Representationscited by 6
  9. 2020Oblivious Data for Fairness with Kernelscited by 5
  10. 2023Kernel Debiased Plug-in Estimation: Simultaneous, Automated Debiasing without Influence Functions for Many Target Parameterscited by 5
  11. 2024GATE X-E : A Challenge Set for Gender-Fair Translations from Weakly-Gendered Languagescited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Does LLM Focus on the Right Words? Mitigating Context Bias in LLM-based Recommenders
  2. 2025Neutralizing Popularity Bias in LLM-based Recommendation via Counterfactual Reasoning Guidelines
  3. 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges
  4. 2025Rethinking LLM-Based Recommendations: A Personalized Query-Driven Parallel Integration
  5. 2024Unveiling and Mitigating Bias in Large Language Model Recommendations: A Path to Fairness
  6. 2025Investigating and Mitigating Stereotype-aware Unfairness in LLM-based Recommendations
  7. 2025Improving Recommendation Fairness without Sensitive Attributes Using Multi-Persona LLMs
  8. 2025Selective LLM-Guided Regularization for Enhancing Recommendation Models