mlsanityData to 14 Oct 2026

Test-Time Scaling Strategies for Generative Retrieval in Multimodal Conversational Recommendations

arXiv 2508.18132 ↗First posted 25 Aug 2025cs.IR cs.AI cs.LGcited by 1

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging multimodal large language models (MLLMs) as retrievers -- have shown promise. However, most existing methods are tailored to single-turn scenarios and struggle to model the evolving intent and iterative nature of multi-turn dialogues when applied naively. Concurrently, test-time scaling has emerged as a powerful paradigm for improving large language model (LLM) performance through iterative inference-time refinement. Yet, its effectiveness typically relies on two conditions: (1) a well-defined problem space (e.g., mathematical reasoning), and (2) the model's ability to self-correct -- conditions that are rarely met in conversational product search. In this setting, user queries are often ambiguous and evolving, and MLLMs alone have difficulty grounding responses in a fixed product corpus. Motivated by these challenges, we propose a novel framework that introduces test-time scaling into conversational multimodal product retrieval. Our approach builds on a generative retriever, further augmented with a test-time reranking (TTR) mechanism that improves retrieval accuracy and better aligns results with evolving user intent throughout the dialogue. Experiments across multiple benchmarks show consistent improvements, with average gains of 14.5 points in MRR and 10.6 points in nDCG@1.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 56 references that are in the map. First posted on arXiv 25 Aug 2025.

Builds on

45 of 56 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Rank1: Test-Time Compute for Reranking in Information Retrieval25 Feb

Other references · 44

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  7. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  8. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  9. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  10. 2021Unifying Vision-and-Language Tasks via Text Generationcited by 412
  11. 2020Autoregressive Entity Retrievalcited by 334
  12. 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 295
32 more
  1. 2022Transformer Memory as a Differentiable Search Indexcited by 247
  2. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 213
  3. 2023Recommender Systems with Generative Retrievalcited by 198
  4. 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMscited by 161
  5. 2023Query2doc: Query Expansion with Large Language Modelscited by 149
  6. 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
  7. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 113
  8. 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
  9. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  10. 2020Few-Shot Generative Conversational Query Rewritingcited by 85
  11. 2023Generative Recommendation: Towards Next-generation Recommender Paradigmcited by 70
  12. 2021CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learningcited by 68
  13. 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decodingcited by 63
  14. 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
  15. 2023Learning to Rank in Generative Retrievalcited by 46
  16. 2025ReVISE: Learning to Refine at Test-Time via Intrinsic Self-Verificationcited by 35
  17. 2021Conversational Fashion Image Retrieval via Multiturn Natural Language Feedbackcited by 29
  18. 2024Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyondcited by 28
  19. 2024Generative Multi-Modal Knowledge Retrieval with Large Language Modelscited by 22
  20. 2023MG-ShopDial: A Multi-Goal Conversational Dataset for e-Commercecited by 19
  21. 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 19
  22. 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generationcited by 17
  23. 2023Multiview Identifiers Enhanced Generative Retrievalcited by 16
  24. 2023Zero-shot Clarifying Question Generation for Conversational Searchcited by 14
  25. 2024Efficient Inference for Large Language Model-based Generative Recommendationcited by 11
  26. 2024Generative Retrieval with Preference Optimization for E-commerce Searchcited by 10
  27. 2024Test-time Adaptation for Cross-modal Retrieval with Query Shiftcited by 10
  28. 2024Asking Multimodal Clarifying Questions in Mixed-Initiative Conversational Searchcited by 8
  29. 2024Muse: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profilescited by 8
  30. 2025LLM Alignment as Retriever Optimization: An Information Retrieval Perspectivecited by 7
  31. 2025Language Models can Self-Improve at State-Value Estimation for Better Searchcited by 4
  32. 2025SemCORE: A Semantic-Enhanced Generative Cross-Modal Retrieval Framework with MLLMscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2021Distilling the Knowledge of Large-scale Generative Models into Retrieval Models for Efficient Open-domain Conversation
  2. 2024Leveraging Large Language Models for Multimodal Search
  3. 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation
  4. 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA
  5. 2024Retrieve, Annotate, Evaluate, Repeat: Leveraging Multimodal LLMs for Large-Scale Product Retrieval Evaluation
  6. 2025Exploring Training and Inference Scaling Laws in Generative Retrieval
  7. 2024Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation
  8. 2025mRAG: Elucidating the Design Space of Multi-modal Retrieval-Augmented Generation