mlsanityData to 7 Oct 2026

Granite Embedding R2 Models

arXiv 2508.21085 ↗First posted 26 Aug 2025cs.CL cs.IRcited by 7

Not on the map. Why?

Abstract (arXiv)

We introduce the Granite Embedding R2 models, a comprehensive family of high-performance English encoder-based embedding models engineered for enterprise-scale dense retrieval applications. Building upon our first-generation release, these models deliver substantial improvements, including 16x expanded context length (8,192 tokens), state-of-the-art performance across diverse retrieval domains - text, code, long-document search, multi-turn conversational, and tabular data - and measurable speed advantages of 19-44% over leading competitors while maintaining superior accuracy. Our release encompasses both bi-encoder and cross-encoder architectures, featuring a highly effective 22-layer retriever model and its efficient 12-layer counterpart, alongside a high-quality reranker model, all trained exclusively on enterprise-appropriate data with comprehensive governance oversight. The models demonstrate exceptional versatility across standard benchmarks, IBM-developed evaluation suites, and real-world enterprise use cases, establishing new performance standards for open-source embedding models. In an era where retrieval speed and accuracy are paramount for competitive advantage, the Granite R2 models deliver a compelling combination of cutting-edge performance, enterprise-ready licensing, and transparent data provenance that organizations require for mission-critical deployments. All models are publicly available under the Apache 2.0 license at https://huggingface.co/collections/ibm-granite, enabling unrestricted research and commercial use.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 26 Aug 2025.

Builds on

45 of 55 references.

References · 45

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  6. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  7. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  8. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  9. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  10. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  11. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  12. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
33 more
  1. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  2. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 694
  3. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  4. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
  5. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  6. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  7. 2019How to Fine-Tune BERT for Text Classification?cited by 409
  8. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
  9. 2023Improving Text Embeddings with Large Language Modelscited by 295
  10. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  11. 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
  12. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 221
  13. 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
  14. 2020Open Question Answering over Tables and Textcited by 163
  15. 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
  16. 2020Top2Vec: Distributed Representations of Topicscited by 124
  17. 2021PubTables-1M: Towards comprehensive table extraction from unstructured documentscited by 122
  18. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 120
  19. 2022RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encodercited by 118
  20. 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 116
  21. 2021Open Domain Question Answering over Tables via Dense Retrievalcited by 74
  22. 2024CoIR: A Comprehensive Benchmark for Code Information Retrieval Modelscited by 59
  23. 2021MultiDoc2Dial: Modeling Dialogues Grounded in Multiple Documentscited by 53
  24. 2020SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrievalcited by 50
  25. 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 50
  26. 2024LongEmbed: Extending Embedding Models for Long Context Retrievalcited by 47
  27. 2021GitTables: A Large-Scale Corpus of Relational Tablescited by 44
  28. 2021AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industrycited by 44
  29. 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
  30. 2022StruBERT: Structure-aware BERT for Table Search and Matchingcited by 24
  31. 2025TARGET: Benchmarking Table Retrieval for Generative Taskscited by 17
  32. 2025GneissWeb: Preparing High Quality Data for LLMs at Scalecited by 6
  33. 2025Structural Deep Encoding for Table Question Answeringcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 2.

7 papers.