mlsanityData to 7 Oct 2026

Jina Embeddings: A Novel Set of High-Performance Sentence Embedding Models

arXiv 2307.11224 ↗First posted 20 Jul 2023cs.CL cs.AI cs.IRcited by 35

Not on the map. Why?

Abstract (arXiv)

Jina Embeddings constitutes a set of high-performance sentence embedding models adept at translating textual inputs into numerical representations, capturing the semantics of the text. These models excel in applications like dense retrieval and semantic textual similarity. This paper details the development of Jina Embeddings, starting with the creation of high-quality pairwise and triplet datasets. It underlines the crucial role of data cleaning in dataset preparation, offers in-depth insights into the model training process, and concludes with a comprehensive performance evaluation using the Massive Text Embedding Benchmark (MTEB). Furthermore, to increase the model's awareness of grammatical negation, we construct a novel training and evaluation dataset of negated and non-negated statements, which we make publicly available to the community.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 20 Jul 2023.

Builds on

18 of 24 references.

References · 18

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  6. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  7. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  8. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  9. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  10. 2018Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidatescited by 632
  11. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  12. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
6 more
  1. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
  2. 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
  3. 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
  4. 2022Promptagator: Few-shot Dense Retrieval From 8 Examplescited by 233
  5. 2022SGPT: GPT Sentence Embeddings for Semantic Searchcited by 204
  6. 2022Scaling Laws and Interpretability of Learning from Repeated Datacited by 147

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 17; 2025: 12; 2026: 5.

35 papers.

Sort:

By area:

  1. 2024Generative Representational Instruction Tuningcited by 227
  2. 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 103
  3. 2025LocAgent: Graph-Guided LLM Agents for Code Localizationcited by 82
  4. 2024Arctic-Embed 2.0: Multilingual Retrieval Without Compromisecited by 57
  5. 2024Jina CLIP: Your CLIP Model Is Also Your Text Retrievercited by 46
  6. 2024CoRNStack: High-Quality Contrastive Data for Better Code Retrieval and Rerankingcited by 37
  7. 2024Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddingscited by 20
  8. 2025SweRank: Software Issue Localization with Code Rankingcited by 20
  9. 2024CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generationcited by 18
  10. 2024Improving General Text Embedding Model: Tackling Task Conflict and Data Imbalance through Model Mergingcited by 14
  11. 2025Interpretable Text Embeddings and Text Similarity Explanation: A Surveycited by 12
  12. 2024CoFE-RAG: A Comprehensive Full-chain Evaluation Framework for Retrieval-Augmented Generation with Enhanced Data Diversitycited by 11
23 more
  1. 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaningcited by 10
  2. 2025SAIL-Embedding Technical Report: Omni-modal Embedding Foundation Modelcited by 10
  3. 2024Effective and Efficient Conversation Retrieval for Dialogue State Tracking with Implicit Text Summariescited by 8
  4. 2024Graph-Based Captioning: Enhancing Visual Descriptions by Interconnecting Region Captionscited by 7
  5. 2025CUPCase: Clinically Uncommon Patient Cases and Diagnoses Datasetcited by 6
  6. 2025Training LLMs to be Better Text Embedders through Bidirectional Reconstructioncited by 6
  7. 2024Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipecited by 4
  8. 2025Sentence Smith: Controllable Edits for Evaluating Text Embeddingscited by 4
  9. 2024Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understandingcited by 3
  10. 2025Agentic RAG with Knowledge Graphs for Complex Multi-Hop Reasoning in Real-World Applicationscited by 3
  11. 2025On The Role of Pretrained Language Models in General-Purpose Text Embeddings: A Surveycited by 3
  12. 2024Do You Know What You Are Talking About? Characterizing Query-Knowledge Relevance For Reliable Retrieval Augmented Generationcited by 2
  13. 2024T"ubingen-CL at SemEval-2024 Task 1:Ensemble Learning for Semantic Relatedness Estimationcited by 2
  14. 2026ALEE: Any-Language Evaluation of Embeddings via English-Centric Minimal Pairscited by 1
  15. 2024Data-CUBE: Data Curriculum for Instruction-based Sentence Representation Learningcited by 0
  16. 2024How Similar Are Elected Politicians and Their Constituents? Quantitative Evidence From Online Social Networkscited by 0
  17. 2024GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionarycited by 0
  18. 2025Multi-Task Pre-Finetuning of Lightweight Transformer Encoders for Text Classification and NERcited by 0
  19. 2025Dual Refinement Cycle Learning: Unsupervised Text Classification of Mamba and Community Detection on Text Attributed Graphcited by 0
  20. 2026EmbeddingRWKV: State-Centric Retrieval with Reusable Statescited by 0
  21. 2026GREPO: A Benchmark for Graph Neural Networks on Repository-Level Bug Localizationcited by 0
  22. 2026KAMR: Grounding Generation via Knowledge-Aligned Multi-hop Retrievalcited by 0
  23. 2026HyperFL: Query-Adaptive Representation Learning for Software Fault Localizationcited by 0