GENIUS: A Generative Framework for Universal Multimodal Search
Not on the map. Why?
Abstract (arXiv)
Generative retrieval is an emerging approach in information retrieval that generates identifiers (IDs) of target data based on a query, providing an efficient alternative to traditional embedding-based retrieval methods. However, existing models are task-specific and fall short of embedding-based retrieval in performance. This paper proposes GENIUS, a universal generative retrieval framework supporting diverse tasks across multiple modalities and domains. At its core, GENIUS introduces modality-decoupled semantic quantization, transforming multimodal data into discrete IDs encoding both modality and semantics. Moreover, to enhance generalization, we propose a query augmentation that interpolates between a query and its target, allowing GENIUS to adapt to varied query forms. Evaluated on the M-BEIR benchmark, it surpasses prior generative methods by a clear margin. Unlike embedding-based retrieval, GENIUS consistently maintains high retrieval speed across database size, with competitive performance across multiple benchmarks. With additional re-ranking, GENIUS often achieves results close to those of embedding-based methods while preserving efficiency.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 52 of its 63 references that are in the map. First posted on arXiv 25 Mar 2025.
Builds on
52 of 63 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
38 more
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2019Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-trainingcited by 451
- 2015Deep Metric Learning via Lifted Structured Feature Embeddingcited by 449
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2020Autoregressive Entity Retrievalcited by 334
- 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 286
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
- 2019Document Expansion by Query Predictioncited by 231
- 2017No Fuss Distance Metric Learning using Proxiescited by 226
- 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
- 2023Recommender Systems with Generative Retrievalcited by 198
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2023UniIR: Training and Benchmarking Universal Multimodal Information Retrieverscited by 166
- 2023Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrievalcited by 156
- 2017Automatic Spatially-aware Fashion Concept Discoverycited by 134
- 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
- 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 113
- 2023Open-domain Visual Entity Recognition: Towards Recognizing Millions of Wikipedia Entitiescited by 113
- 2022A Neural Corpus Indexer for Document Retrievalcited by 111
- 2021WebQA: Multihop and Multimodal QAcited by 109
- 2023Learning to Tokenize for Generative Retrievalcited by 68
- 2023Sentence-level Prompts Benefit Composed Image Retrievalcited by 59
- 2022Universal Vision-Language Dense Retrieval: Learning A Unified Representation Space for Multi-Modal Retrievalcited by 58
- 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
- 2022DSI++: Updating Transformer Memory with New Documentscited by 35
- 2020Universal Weighting Metric Learning for Cross-Modal Matchingcited by 34
- 2022Improving Cross-Modal Retrieval with Set of Diverse Embeddingscited by 33
- 2024Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models for Retrieval and Beyondcited by 28
- 2023EDIS: Entity-Driven Image Search over Multimodal Web Contentcited by 27
- 2023Semantic-Enhanced Differentiable Search Index Inspired by Learning Strategiescited by 25
- 2023End-to-end Knowledge Retrieval with Multi-modal Queriescited by 23
- 2023Language Models As Semantic Indexerscited by 20
- 2023IRGen: Generative Modeling for Image Retrievalcited by 18
- 2021Telling the What while Pointing to the Where: Multimodal Queries for Image Retrievalcited by 12
- 2024Bringing Multimodality to Amazon Visual Search Systemcited by 10
- 2023Generative Retrieval as Dense Retrievalcited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025Recurrence Meets Transformers for Universal Multimodal Retrievalcited by 3
- 2025Sequential Data Augmentation for Generative Recommendationcited by 2
- 2025OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Searchcited by 2
- 2025Breaking the Visual Shortcuts in Multimodal Knowledge-Based Visual Question Answeringcited by 2
- 2026Generative Universal Multimodal Retrieval with Dual-role Identifierscited by 0
- 2026Generative Universal Multimodal Retrieval with Dual-role Identifiers13 Aug 2026
- 2025Breaking the Visual Shortcuts in Multimodal Knowledge-Based Visual Question Answering28 Nov 2025
- 2025OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Search7 Oct 2025
- 2025Sequential Data Augmentation for Generative Recommendation17 Sep 2025
- 2025Recurrence Meets Transformers for Universal Multimodal Retrieval10 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities
- 2025SemCORE: A Semantic-Enhanced Generative Cross-Modal Retrieval Framework with MLLMs
- 2025MLLM-Driven Semantic Identifier Generation for Generative Cross-Modal Retrieval
- 2025RAG-Anything: All-in-One RAG Framework
- 2025Generative Giants, Retrieval Weaklings: Why do Multimodal Large Language Models Fail at Multimodal Retrieval?
- 2025ReMatch: Boosting Representation through Matching for Multimodal Retrieval
- 2024Breaking the Hourglass Phenomenon of Residual Quantization: Enhancing the Upper Bound of Generative Retrieval
- 2025Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation