Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation
Not on the map. Why?
Abstract (arXiv)
LLM-based Cross-Domain Sequential Recommendation (CDSR) leverages LLMs to enhance target performance via deep semantic reasoning, alleviating the dependency on overlapping users. Among LLM-based paradigms, model merging is particularly promising for multi-domain scenarios due to its superior scalability and flexibility in integrating diverse knowledge sources. However, our empirical investigations reveal two critical bottlenecks: (1) cross-domain knowledge conflict; and (2) performance saturation in multi-domain fusion. Our analysis attributes these phenomena to parameter-level misalignment and statistical homogenization during the merging process. To address these bottlenecks, we propose SharpRec, Sharpness-aware Model Merging with Salience Recovery for LLM-based CDSR, a framework designed to lift the performance upper bound of merged models. SharpRec incorporates two synergistic modules: Sharpness-aware Geometric Alignment to establish a stable geometric foundation for interference-free fusion; and Preference Salience Activation to effectively recover the distinctive features essential for bolstering target domain performance. Extensive experiments in both dual-domain and multi-domain scenarios demonstrate that SharpRec consistently outperforms state-of-the-art baselines.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
31 of 49 references.
References · 31
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
- 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2024eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Datacited by 44
- 2023Diffusion Augmentation for Sequential Recommendationcited by 37
- 2021DA-GCN: A Domain-aware Attentive Graph Convolution Network for Shared-account Cross-domain Sequential Recommendationcited by 34
- 2024M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Frameworkcited by 32
- 2023Contrastive Cross-Domain Sequential Recommendationcited by 31
- 2023Bridging Items and Language: A Transition Paradigm for Large Language Model-Based Recommendationcited by 29
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 26
19 more
- 2020Mixed Information Flow for Cross-domain Sequential Recommendationscited by 22
- 2019Parallel Split-Join Networks for Shared-account Cross-domain Sequential Recommendationscited by 21
- 2023Rethinking Cross-Domain Sequential Recommendation under Open-World Assumptionscited by 20
- 2024Exploring User Retrieval Integration towards Large Language Models for Cross-Domain Sequential Recommendationcited by 19
- 2021Dual Attentive Sequential Learning for Cross-Domain Click-Through Rate Predictioncited by 17
- 2023One Model for All: Large Language Models are Domain-Agnostic Recommendation Systemscited by 17
- 2024A Survey on Cross-Domain Sequential Recommendationcited by 16
- 2024Mimir: Improving Video Diffusion Models for Precise Text Understandingcited by 16
- 2025Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuningcited by 16
- 2025Bridge the Domains: Large Language Models Enhanced Cross-domain Sequential Recommendationcited by 15
- 2024Pacer and Runner: Cooperative Learning Framework between Single- and Cross-Domain Sequential Recommendationcited by 13
- 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Modelscited by 12
- 2023Towards Open-world Cross-Domain Sequential Recommendation: A Model-Agnostic Contrastive Denoising Approachcited by 4
- 2025Uncovering Cross-Domain Recommendation Ability of Large Language Modelscited by 4
- 2025Generalized Category Discovery under Domain Shift: A Frequency Domain Perspectivecited by 4
- 2025WeaveRec: An LLM-Based Cross-Domain Sequential Recommendation Framework with Model Mergingcited by 3
- 2023Cross Domain LifeLong Sequential Modeling for Online Click-Through Rate Predictioncited by 2
- 2024Cross-Domain Sequential Recommendation via Neural Processcited by 2
- 2025X-Cross: Dynamic Integration of Language Models for Cross-Domain Sequential Recommendationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.