mlsanityData to 14 Oct 2026

Not All Is Lost: Repairing Lossy User Preference States of Personalization Encoders

arXiv 2610.01270 ↗First posted 1 Oct 2026cs.LG cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Personalization encoders compress evolving interaction histories into preference states used to rank items or condition text generation. A task head operating only on this state can miss useful evidence that remains in the frozen encoder's cached representations for individual timesteps. We study this recoverability gap and propose REPAIR, which compares cached representations with the current preference state in a compact learned coordinate space. It resolves corrective evidence over extended history, recent interactions, and localized bursts. It then selects which patterns at which timesteps contribute and adds their aggregate correction to the state before the task head. Encoder-host repair reuses representations from the existing forward computation without re-encoding the history. Across MovieLens, PENS, MIND, and Amazon Reviews 2023, training only REPAIR improves MRR and nDCG@10 for all twelve representative recommendation hosts while both encoder and task head remain frozen. Head-only finetuning of the same hosts yields smaller gains. For example, Mamba4Rec on MovieLens gains 3.96 MRR points, compared with 0.19 from head-only finetuning. Rank and temporal diagnostics support a compact, host-dependent corrective structure. In personalized generation, IMPerSumm improves the two reported weighted PerSEval variants, which assess responsiveness to user preference, by up to 25.23%. These results support post-compression state correction and distinguish the availability of preference evidence from its downstream use.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 66 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

12 of 66 references.

References · 12

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2017Decoupled Weight Decay Regularizationcited by 1,831
  5. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  6. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  7. 2018Self-Attentive Sequential Recommendationcited by 1,184
  8. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  9. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  10. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 224
  11. 2024Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Modelscited by 26
  12. 2025SS4Rec: Continuous-Time Sequential Recommendation with State Space Modelscited by 2

Built on by

Not cited yet.