mlsanityData to 7 Oct 2026

Personalized LLM Response Generation with Parameterized Memory Injection

arXiv 2404.03565 ↗First posted 4 Apr 2024cs.CLcited by 33

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have exhibited remarkable proficiency in comprehending and generating natural language. On the other hand, personalized LLM response generation holds the potential to offer substantial benefits for individuals in critical areas such as medical. Existing research has explored memory-augmented methods to prompt the LLM with pre-stored user-specific knowledge for personalized response generation in terms of new queries. We contend that such paradigm is unable to perceive fine-granularity information. In this study, we propose a novel Memory-injected approach using parameter-efficient fine-tuning (PEFT) and along with a Bayesian Optimisation searching strategy to achieve LLM Personalization(MiLP).

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 4 Apr 2024.

Builds on

31 of 45 references.

References · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  9. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  10. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  11. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  12. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
19 more
  1. 2021Towards a Unified View of Parameter-Efficient Transfer Learningcited by 863
  2. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  3. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  4. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 443
  5. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  6. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  7. 2023Pretraining Language Models with Human Preferencescited by 245
  8. 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
  9. 2021Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvementcited by 115
  10. 2022Revisiting Parameter-Efficient Tuning: Are We Really There Yet?cited by 76
  11. 2023AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuningcited by 49
  12. 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
  13. 2021One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profilescited by 39
  14. 2022Kformer: Knowledge Injection in Transformer Feed-Forward Layerscited by 37
  15. 2022Towards Teachable Reasoning Systems: Using a Dynamic Memory of User Feedback for Continual System Improvementcited by 37
  16. 2021Learning to Repair: Repairing model output errors after deployment using a dynamic memory of feedbackcited by 35
  17. 2023Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memoriescited by 34
  18. 2022Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generationcited by 17
  19. 2021Towards Personalized Answer Generation in E-Commerce via Multi-Perspective Preference Modelingcited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 16; 2026: 12.

33 papers.

Sort:

By area:

  1. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  2. 2025Memory OS of AI Agentcited by 140
  3. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  4. 2025A Survey of Personalized Large Language Models: Progress and Future Directionscited by 65
  5. 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
  6. 2024LLMs + Persona-Plug = Personalized LLMscited by 29
  7. 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 21
  8. 2025A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigmscited by 17
  9. 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Processcited by 16
  10. 2024MADial-Bench: Towards Real-world Evaluation of Memory-Augmented Dialogue Generationcited by 15
  11. 2025Evaluating Long-Context Reasoning in LLM-Based WebAgentscited by 15
  12. 2025TeleMem: Building Long-Term and Multimodal Memory for Agentic AIcited by 14
21 more
  1. 2025Personalized LLM Decoding via Contrasting Personal Preferencecited by 12
  2. 2025CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steeringcited by 12
  3. 2025AI Meets Brain: Memory Systems from Cognitive Neuroscience to Autonomous Agentscited by 12
  4. 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interactioncited by 11
  5. 2024Privacy-preserved LLM Cascade via CoT-enhanced Policy Learningcited by 8
  6. 2025Mitigating Memorization in LLMs using Activation Steeringcited by 7
  7. 2026How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistantscited by 7
  8. 2025The Personalization Trap: How User Memory Alters Emotional Reasoning in LLMscited by 5
  9. 2026CURP: Codebook-based Continuous User Representation for Personalized Generation with LLMscited by 3
  10. 2026EXACT: Explicit Attribute-Guided Decoding-Time Personalizationcited by 3
  11. 2025Rehearse With User: Personalized Opinion Summarization via Role-Playing based on Large Language Modelscited by 2
  12. 2026CARD: Cluster-level Adaptation with Reward-guided Decoding for Personalized Text Generationcited by 2
  13. 2024Multi-Objective Neural Architecture Search by Learning Search Space Partitionscited by 1
  14. 2026TSUBASA: Improving Long-Horizon Personalization via Evolving Memory and Self-Learning with Context Distillationcited by 1
  15. 2026VitalDiagnosis: AI-Driven Ecosystem for 24/7 Vital Monitoring and Chronic Disease Managementcited by 0
  16. 2026User-Aware Active Knowledge Acquisition for Emotional Support Dialoguecited by 0
  17. 2026Beyond Isolated Behaviors: Hierarchical User Modeling for LLM Personalizationcited by 0
  18. 2026Training-Free VLM Personalization via Calibrated Residual Decodingcited by 0
  19. 2026Behaviorally Grounded User Profiles from the Wild for Personalized Alignment and Multi-Perspective Reasoningcited by 0
  20. 2026PLUME: Parameter-Efficient Personalization of Large Language Models via Low-Rank User Modulation in Shared Subspacescited by 0
  21. 2026Gradient-Aligned Pair Selection for Personalized Preference Optimizationcited by 0