F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual World
Not on the map. Why?
Abstract (arXiv)
We present F2LLM-v2, a new family of general-purpose, multilingual embedding models in 8 distinct sizes ranging from 80M to 14B. Trained on a newly curated composite of 60 million publicly available high-quality data samples, F2LLM-v2 supports more than 200 languages, with a particular emphasis on previously underserved mid- and low-resource languages. By integrating a two-stage LLM-based embedding training pipeline with matryoshka learning, model pruning, and knowledge distillation techniques, we present models that are far more efficient than previous LLM-based embedding models while retaining competitive performances. Extensive evaluations confirm that F2LLM-v2-14B ranks first on 11 MTEB benchmarks, while the smaller models in the family also set a new state of the art for resource-constrained applications. To facilitate open-source embedding model research, we release all models, data, code, and intermediate checkpoints.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 87 of its 132 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
87 of 132 references.
References · 87
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,356
38 more
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2015Teaching Machines to Read and Comprehendcited by 1,049
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
- 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
- 2022MTEB: Massive Text Embedding Benchmarkcited by 640
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2019ELI5: Long Form Question Answeringcited by 575
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 543
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2023Improving Text Embeddings with Large Language Modelscited by 303
- 2022Matryoshka Representation Learningcited by 282
- 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 278
- 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 264
- 2024Generative Representational Instruction Tuningcited by 233
- 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
- 2020CORD-19: The COVID-19 Open Research Datasetcited by 180
- 2020MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmarkcited by 158
- 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
- 2023SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialectscited by 152
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 146
- 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
- 2019A Question-Entailment Approach to Question Answeringcited by 134
- 2025MMTEB: Massive Multilingual Text Embedding Benchmarkcited by 125
- 2020MLSUM: The Multilingual Summarization Corpuscited by 121
- 2021Mr. TyDi: A Multi-lingual Benchmark for Dense Retrievalcited by 119
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2017DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applicationscited by 110
- 2023AlpaCare:Instruction-tuned Large Language Models for Medical Applicationcited by 90
50 most cited of 87 All 87 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agentscited by 39
- 2026CORE-Bench: A Comprehensive Benchmark for Code Retrieval in the Era of Agentic Codingcited by 7
- 2026The Embedder's Dilemma: LLMs Are Better, but at What Cost?cited by 5
- 2026Low-Cost Black-Box Detection of LLM Hallucinations via Dynamical System Predictioncited by 3
- 2026LatentRAG: Latent Reasoning and Retrieval for Efficient Agentic RAGcited by 0
- 2026Lychee-Reranker: Fast but Not Late Interaction for Compressed Document Rerankingcited by 0
- 2026MTEB-BR: A Text Embedding Benchmark for Brazilian Portuguesecited by 0
- 2026Multimodal Ambivalence and Hesitancy Recognition via Cross-Attention and Gated Fusioncited by 0
- 2026Auditable CT Phenotyping Through Report-derived Radiological Observationscited by 0
- 2026Explainable Multi-Loss Distillation Framework for Efficient and Interpretable Shrimp Disease Text Classificationcited by 0
- 2026When Do Agents Help? Embedding, LLM and Agentic Alignment of Classical Texts and Their Translationscited by 0
- 2026Your Prompt Should Do More: Effects of Retrieval Instructions in Embedding Modelscited by 0
- 2026Your Prompt Should Do More: Effects of Retrieval Instructions in Embedding Models7 Oct 2026
- 2026When Do Agents Help? Embedding, LLM and Agentic Alignment of Classical Texts and Their Translations27 Sep 2026
- 2026Explainable Multi-Loss Distillation Framework for Efficient and Interpretable Shrimp Disease Text Classification29 Aug 2026
- 2026Auditable CT Phenotyping Through Report-derived Radiological Observations26 Aug 2026
- 2026The Embedder's Dilemma: LLMs Are Better, but at What Cost?13 Aug 2026
- 2026Multimodal Ambivalence and Hesitancy Recognition via Cross-Attention and Gated Fusion17 Jul 2026
- 2026MTEB-BR: A Text Embedding Benchmark for Brazilian Portuguese6 Jul 2026
- 2026Lychee-Reranker: Fast but Not Late Interaction for Compressed Document Reranking22 Jun 2026
- 2026CORE-Bench: A Comprehensive Benchmark for Code Retrieval in the Era of Agentic Coding10 Jun 2026
- 2026LatentRAG: Latent Reasoning and Retrieval for Efficient Agentic RAG7 May 2026
- 2026SkillRet: A Large-Scale Benchmark for Skill Retrieval in LLM Agents7 May 2026
- 2026Low-Cost Black-Box Detection of LLM Hallucinations via Dynamical System Prediction6 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025KaLM-Embedding: Superior Training Data Brings A Stronger Embedding Model
- 2025xVLM2Vec: Adapting LVLM-based embedding models to multilinguality using Self-Knowledge Distillation
- 2026Bootstrapping Embeddings for Low Resource Languages
- 2025Tracing Multilingual Representations in LLMs with Cross-Layer Transcoders
- 2024FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data
- 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias
- 2024Multi-Lingual Malaysian Embedding: Leveraging Large Language Models for Semantic Representations
- 2025Towards Inclusive NLP: Assessing Compressed Multilingual Transformers across Diverse Language Benchmarks