mlsanityData to 7 Oct 2026

R2R: A Route-to-Rerank Post-Training Framework for Multi-Domain Decoder-Only Rerankers

arXiv 2511.19987 ↗First posted 25 Nov 2025cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

Decoder-only rerankers are central to Retrieval-Augmented Generation (RAG). However, generalist models miss domain-specific nuances in high-stakes fields like finance and law, and naive fine-tuning causes surface-form overfitting and catastrophic forgetting. To address this challenge, we introduce R2R, a domain-aware framework that combines dynamic expert routing with a two-stage training strategy, Entity Abstraction for Generalization (EAG). EAG introduces a counter-shortcut mechanism by masking the most predictive surface cues, forcing the reranker to learn domain-invariant relevance patterns rather than memorizing dataset-specific entities. To efficiently activate domain experts, R2R employs a lightweight Latent Semantic Router that probes internal representations from the frozen backbone decoder to select the optimal LoRA expert per query. Extensive experiments across different reranker backbones and diverse domains (legal, medical, and financial) demonstrate that R2R consistently surpasses generalist and single-domain fine-tuned baselines. Our results confirm that R2R is a model-agnostic and modular approach to domain specialization with strong cross-domain robustness.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 14 of its 21 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

14 of 21 references.

References · 14

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  3. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  4. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  5. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  6. 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 324
  7. 2024Scaling Laws for Forgetting When Fine-Tuning Large Language Modelscited by 36
  8. 2025OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting during Parameter-Efficient Fine-Tuningcited by 20
  9. 2025LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversationcited by 19
  10. 2024LoRA-Switch: Boosting the Efficiency of Dynamic LLM Adapters via System-Algorithm Co-designcited by 18
  11. 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Expertscited by 14
  12. 2025LD-MoLE: Learnable Dynamic Routing for Mixture of LoRA Expertscited by 12
2 more
  1. 2025Ensembles of Low-Rank Expert Adapterscited by 9
  2. 2025RAGRouter: Learning to Route Queries to Multiple Retrieval-Augmented Language Modelscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking
  2. 2026Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking
  3. 2023Efficient Title Reranker for Fast and Improved Knowledge-Intense NLP
  4. 2024JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking
  5. 2025Embedding-Based Context-Aware Reranker
  6. 2026Prism-Reranker: Beyond Relevance Scoring -- Jointly Producing Contributions and Evidence for Agentic Retrieval
  7. 2025Rank1: Test-Time Compute for Reranking in Information Retrieval
  8. 2025Enhancing Transformer-Based Rerankers with Synthetic Data and LLM-Based Supervision