Test-Time Scaling Strategies for Generative Retrieval in Multimodal Conversational Recommendations
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging multimodal large language models (MLLMs) as retrievers -- have shown promise. However, most existing methods are tailored to single-turn scenarios and struggle to model the evolving intent and iterative nature of multi-turn dialogues when applied naively. Concurrently, test-time scaling has emerged as a powerful paradigm for improving large language model (LLM) performance through iterative inference-time refinement. Yet, its effectiveness typically relies on two conditions: (1) a well-defined problem space (e.g., mathematical reasoning), and (2) the model's ability to self-correct -- conditions that are rarely met in conversational product search. In this setting, user queries are often ambiguous and evolving, and MLLMs alone have difficulty grounding responses in a fixed product corpus. Motivated by these challenges, we propose a novel framework that introduces test-time scaling into conversational multimodal product retrieval. Our approach builds on a generative retriever, further augmented with a test-time reranking (TTR) mechanism that improves retrieval accuracy and better aligns results with evolving user intent throughout the dialogue. Experiments across multiple benchmarks show consistent improvements, with average gains of 14.5 points in MRR and 10.6 points in nDCG@1.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 56 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
45 of 56 references.
Closest ancestors · 1
Same direction, newest first
Other references · 44
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Let's Verify Step by Stepcited by 3,789
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2021Unifying Vision-and-Language Tasks via Text Generationcited by 412
- 2020Autoregressive Entity Retrievalcited by 334
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 295
32 more
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
- 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 213
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMscited by 161
- 2023Query2doc: Query Expansion with Large Language Modelscited by 149
- 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
- 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 113
- 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
- 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
- 2020Few-Shot Generative Conversational Query Rewritingcited by 85
- 2023Generative Recommendation: Towards Next-generation Recommender Paradigmcited by 70
- 2021CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement Learningcited by 68
- 2025Sampling-Efficient Test-Time Scaling: Self-Estimating the Best-of-N Sampling in Early Decodingcited by 63
- 2023ConvGQR: Generative Query Reformulation for Conversational Searchcited by 59
- 2023Learning to Rank in Generative Retrievalcited by 46
- 2025ReVISE: Learning to Refine at Test-Time via Intrinsic Self-Verificationcited by 35
- 2021Conversational Fashion Image Retrieval via Multiturn Natural Language Feedbackcited by 29
- 2024Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyondcited by 28
- 2024Generative Multi-Modal Knowledge Retrieval with Large Language Modelscited by 22
- 2023MG-ShopDial: A Multi-Goal Conversational Dataset for e-Commercecited by 19
- 2024ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrievalcited by 19
- 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generationcited by 17
- 2023Multiview Identifiers Enhanced Generative Retrievalcited by 16
- 2023Zero-shot Clarifying Question Generation for Conversational Searchcited by 14
- 2024Efficient Inference for Large Language Model-based Generative Recommendationcited by 11
- 2024Generative Retrieval with Preference Optimization for E-commerce Searchcited by 10
- 2024Test-time Adaptation for Cross-modal Retrieval with Query Shiftcited by 10
- 2024Asking Multimodal Clarifying Questions in Mixed-Initiative Conversational Searchcited by 8
- 2024Muse: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profilescited by 8
- 2025LLM Alignment as Retriever Optimization: An Information Retrieval Perspectivecited by 7
- 2025Language Models can Self-Improve at State-Value Estimation for Better Searchcited by 4
- 2025SemCORE: A Semantic-Enhanced Generative Cross-Modal Retrieval Framework with MLLMscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Linking Perception, Confidence and Accuracy in MLLMscited by 2
- 2026Linking Perception, Confidence and Accuracy in MLLMs12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2021Distilling the Knowledge of Large-scale Generative Models into Retrieval Models for Efficient Open-domain Conversation
- 2024Leveraging Large Language Models for Multimodal Search
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation
- 2026Comprehensive Comparison of RAG Methods Across Multi-Domain Conversational QA
- 2024Retrieve, Annotate, Evaluate, Repeat: Leveraging Multimodal LLMs for Large-Scale Product Retrieval Evaluation
- 2025Exploring Training and Inference Scaling Laws in Generative Retrieval
- 2024Think-then-Act: A Dual-Angle Evaluated Retrieval-Augmented Generation
- 2025mRAG: Elucidating the Design Space of Multi-modal Retrieval-Augmented Generation