mlsanityData to 14 Oct 2026

GENIUS: A Generative Framework for Universal Multimodal Search

arXiv 2503.19868 ↗First posted 25 Mar 2025cs.IR cs.AI cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Generative retrieval is an emerging approach in information retrieval that generates identifiers (IDs) of target data based on a query, providing an efficient alternative to traditional embedding-based retrieval methods. However, existing models are task-specific and fall short of embedding-based retrieval in performance. This paper proposes GENIUS, a universal generative retrieval framework supporting diverse tasks across multiple modalities and domains. At its core, GENIUS introduces modality-decoupled semantic quantization, transforming multimodal data into discrete IDs encoding both modality and semantics. Moreover, to enhance generalization, we propose a query augmentation that interpolates between a query and its target, allowing GENIUS to adapt to varied query forms. Evaluated on the M-BEIR benchmark, it surpasses prior generative methods by a clear margin. Unlike embedding-based retrieval, GENIUS consistently maintains high retrieval speed across database size, with competitive performance across multiple benchmarks. With additional re-ranking, GENIUS often achieves results close to those of embedding-based methods while preserving efficiency.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 52 of its 63 references that are in the map. First posted on arXiv 25 Mar 2025.

Builds on

52 of 63 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  8. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  9. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  10. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  11. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  12. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
38 more
  1. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  2. 2019Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-trainingcited by 451
  3. 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
  4. 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
  5. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  6. 2020Autoregressive Entity Retrievalcited by 334
  7. 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 286
  8. 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
  9. 2022Transformer Memory as a Differentiable Search Indexcited by 247
  10. 2019Document Expansion by Query Predictioncited by 231
  11. 2017No Fuss Distance Metric Learning using Proxiescited by 226
  12. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
  13. 2023Recommender Systems with Generative Retrievalcited by 198
  14. 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
  15. 2023UniIR: Training and Benchmarking Universal Multimodal Information Retrieverscited by 166
  16. 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
  17. 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
  18. 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
  19. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 113
  20. 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
  21. 2022A Neural Corpus Indexer for Document Retrievalcited by 111
  22. 2021WebQA: Multihop and Multimodal QAcited by 109
  23. 2023Learning to Tokenize for Generative Retrievalcited by 68
  24. 2023Sentence-level Prompts Benefit Composed Image Retrievalcited by 59
  25. 2022Universal Vision-Language Dense Retrieval: Learning A Unified Representation Space for Multi-Modal Retrievalcited by 58
  26. 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
  27. 2022DSI++: Updating Transformer Memory with New Documentscited by 35
  28. 2020Universal Weighting Metric Learning for Cross-Modal Matchingcited by 34
  29. 2022Improving Cross-Modal Retrieval with Set of Diverse Embeddingscited by 33
  30. 2024Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyondcited by 28
  31. 2023EDIS: Entity-Driven Image Search over Multimodal Web Contentcited by 27
  32. 2023Semantic-Enhanced Differentiable Search Index Inspired by Learning Strategiescited by 25
  33. 2023End-to-end Knowledge Retrieval with Multi-modal Queriescited by 23
  34. 2023Language Models As Semantic Indexerscited by 20
  35. 2023IRGen: Generative Modeling for Image Retrievalcited by 18
  36. 2021Telling the What while Pointing to the Where: Multimodal Queries for Image Retrievalcited by 12
  37. 2024Bringing Multimodality to Amazon Visual Search Systemcited by 10
  38. 2023Generative Retrieval as Dense Retrievalcited by 6

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities
  2. 2025SemCORE: A Semantic-Enhanced Generative Cross-Modal Retrieval Framework with MLLMs
  3. 2025MLLM-Driven Semantic Identifier Generation for Generative Cross-Modal Retrieval
  4. 2025RAG-Anything: All-in-One RAG Framework
  5. 2025Generative Giants, Retrieval Weaklings: Why do Multimodal Large Language Models Fail at Multimodal Retrieval?
  6. 2025ReMatch: Boosting Representation through Matching for Multimodal Retrieval
  7. 2024Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval
  8. 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation