Granite Embedding R2 Models
Not on the map. Why?
Abstract (arXiv)
We introduce the Granite Embedding R2 models, a comprehensive family of high-performance English encoder-based embedding models engineered for enterprise-scale dense retrieval applications. Building upon our first-generation release, these models deliver substantial improvements, including 16x expanded context length (8,192 tokens), state-of-the-art performance across diverse retrieval domains - text, code, long-document search, multi-turn conversational, and tabular data - and measurable speed advantages of 19-44% over leading competitors while maintaining superior accuracy. Our release encompasses both bi-encoder and cross-encoder architectures, featuring a highly effective 22-layer retriever model and its efficient 12-layer counterpart, alongside a high-quality reranker model, all trained exclusively on enterprise-appropriate data with comprehensive governance oversight. The models demonstrate exceptional versatility across standard benchmarks, IBM-developed evaluation suites, and real-world enterprise use cases, establishing new performance standards for open-source embedding models. In an era where retrieval speed and accuracy are paramount for competitive advantage, the Granite R2 models deliver a compelling combination of cutting-edge performance, enterprise-ready licensing, and transparent data provenance that organizations require for mission-critical deployments. All models are publicly available under the Apache 2.0 license at https://huggingface.co/collections/ibm-granite, enabling unrestricted research and commercial use.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
45 of 55 references.
References · 45
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
33 more
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
- 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
- 2022MTEB: Massive Text Embedding Benchmarkcited by 623
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2019How to Fine-Tune BERT for Text Classification?cited by 409
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
- 2023Improving Text Embeddings with Large Language Modelscited by 295
- 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
- 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
- 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
- 2020Open Question Answering over Tables and Textcited by 163
- 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
- 2020Top2Vec: Distributed Representations of Topicscited by 124
- 2021PubTables-1M: Towards comprehensive table extraction from unstructured documentscited by 122
- 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 120
- 2022RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encodercited by 118
- 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 116
- 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
- 2024CoIR: A Comprehensive Benchmark for Code Information Retrieval Modelscited by 59
- 2021MultiDoc2Dial: Modeling Dialogues Grounded in Multiple Documentscited by 53
- 2020SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrievalcited by 50
- 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 50
- 2024LongEmbed: Extending Embedding Models for Long Context Retrievalcited by 47
- 2021GitTables: A Large-Scale Corpus of Relational Tablescited by 44
- 2021AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industrycited by 44
- 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
- 2022StruBERT: Structure-aware BERT for Table Search and Matchingcited by 24
- 2025TARGET: Benchmarking Table Retrieval for Generative Taskscited by 17
- 2025GneissWeb: Preparing High Quality Data for LLMs at Scalecited by 6
- 2025Structural Deep Encoding for Table Question Answeringcited by 2
Built on by
Citing papers per year: 2025: 5; 2026: 2.
7 papers.
- 2025Reference-Free Rating of LLM Responses via Latent Informationcited by 4
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Modelscited by 4
- 2025A Systematic Study of In-the-Wild Model Merging for Large Language Modelscited by 4
- 2025Sparse Autoencoders are Topic Modelscited by 3
- 2026DRBENCHER: Can Your Agent Identify the Entity, Retrieve Its Properties and Do the Math?cited by 1
- 2025WeatherArchive-Bench: Benchmarking Retrieval-Augmented Reasoning for Historical Weather Archivescited by 0
- 2026Embedding Models Measure in Peculiar Wayscited by 0
- 2026Embedding Models Measure in Peculiar Ways17 Sep 2026
- 2026DRBENCHER: Can Your Agent Identify the Entity, Retrieve Its Properties and Do the Math?10 Apr 2026
- 2025A Systematic Study of In-the-Wild Model Merging for Large Language Models26 Nov 2025
- 2025Sparse Autoencoders are Topic Models20 Nov 2025
- 2025WeatherArchive-Bench: Benchmarking Retrieval-Augmented Reasoning for Historical Weather Archives6 Oct 2025
- 2025Person-Centric Annotations of LAION-400M: Auditing Bias and Its Transfer to Models4 Oct 2025
- 2025Reference-Free Rating of LLM Responses via Latent Information29 Sep 2025