mlsanityData to 14 Oct 2026

WIDE: Wildcard Inference with Dynamic Expansion for Cross-Modal Generative Retrieval

arXiv 2609.03554 ↗First posted 3 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative retrieval has demonstrated significant success by unifying representation learning and search into a single sequence-to-sequence generation task. However, extending this paradigm to cross-modal retrieval reveals a critical challenge arising from the inherent information asymmetry across different modalities, such as the gap between concise text queries and dense visual candidates. This structural mismatch causes the autoregressive decoder to suffer from forced hallucination when generating identifiers via standard trie-constrained beam search, where the model is severely penalized for failing to guess fine-grained details absent from the query, allowing irrelevant candidates to hijack top rankings. To address this issue, we propose Wildcard Inference with Dynamic Expansion (WIDE). WIDE employs Adaptive Entropy Thresholding (AET) to calibrate layer-specific uncertainty boundaries offline. During the decoding generation phase, Asymmetry-aware Wildcard Decoding (AWD) detects semantic blind spots and emits wildcards instead of forced deterministic identifiers, dynamically expanding the search space without incurring log-probability penalties. Finally, Blind-Spot Re-ranking (BSR) evaluates the expanded candidate pool using a hybrid scoring mechanism that combines discrete generation confidence with continuous semantic similarity. Extensive experiments on the M-BEIR benchmark demonstrate that WIDE outperforms state-of-the-art generative retrieval methods, effectively suppressing forced hallucination while maintaining compact index structures.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

22 of 40 references.

References · 22

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  5. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  6. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  7. 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
  8. 2022Transformer Memory as a Differentiable Search Indexcited by 247
  9. 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 237
  10. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
  11. 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
  12. 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
10 more
  1. 2019On NMT Search Errors and Model Errors: Cat Got Your Tongue?cited by 114
  2. 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
  3. 2022A Neural Corpus Indexer for Document Retrievalcited by 111
  4. 2016Guided Open Vocabulary Image Captioning with Constrained Beam Searchcited by 105
  5. 2025Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representationscited by 35
  6. 2024Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyondcited by 28
  7. 2023EDIS: Entity-Driven Image Search over Multimodal Web Contentcited by 27
  8. 2024Re3val: Reinforced and Reranked Generative Retrievalcited by 9
  9. 2024CART: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modelingcited by 5
  10. 2025SemCORE: A Semantic-Enhanced Generative Cross-Modal Retrieval Framework with MLLMscited by 4

Built on by

Not cited yet.