PatenTEB: A Comprehensive Benchmark and Model Family for Patent Text Embedding
Not on the map. Why?
Abstract (arXiv)
Patent text embeddings enable prior art search, technology landscaping, and patent analysis, yet existing benchmarks inadequately capture patent-specific challenges. We introduce PatenTEB, a comprehensive benchmark comprising 15 tasks across retrieval, classification, paraphrase, and clustering, with 2.06 million examples. PatenTEB employs domain-stratified splits, domain specific hard negative mining, and systematic coverage of asymmetric fragment-to-document matching scenarios absent from general embedding benchmarks. We develop the patembed model family through multi-task training, spanning 67M to 344M parameters with context lengths up to 4096 tokens. External validation shows strong generalization: patembed-base achieves state-of-the-art on MTEB BigPatentClustering.v2 (0.494 V-measure vs. 0.445 previous best), while patembed-large achieves 0.377 NDCG@100 on DAPFAM. Systematic ablations reveal that multi-task training improves external generalization despite minor benchmark costs, and that domain-pretrained initialization provides consistent advantages across task families. All resources will be made available at https://github.com/iliass-y/patenteb. Keywords: patent retrieval, sentence embeddings, multi-task learning, asymmetric retrieval, benchmark evaluation, contrastive learning.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 32 of its 45 references that are in the map. First posted on arXiv 25 Oct 2025.
Builds on
32 of 45 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
20 more
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
- 2018Universal Sentence Encodercited by 485
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 20218-bit Optimizers via Block-wise Quantizationcited by 395
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
- 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
- 2015Skip-Thought Vectorscited by 321
- 2024mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text Retrievalcited by 233
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
- 2022SGPT: GPT Sentence Embeddings for Semantic Searchcited by 204
- 2019BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarizationcited by 155
- 2022DiffCSE: Difference-based Contrastive Learning for Sentence Embeddingscited by 131
- 2024Natural Language Processing in the Patent Domain: A Surveycited by 20
- 2024PaECTER: Patent-level Representation Learning using Citation-informed Transformerscited by 11
- 2024A Survey on Patent Analysis: From NLP to Multimodal AIcited by 10
- 2024Piccolo2: General Text Embedding with Multi-task Hybrid Loss Trainingcited by 10
- 2025DAPFAM: A Domain-Aware Family-level Dataset to benchmark cross domain patent retrievalcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Citation-Driven Multi-View Training for Patent Embeddings: QaECTER and Sophia-Benchcited by 1
- 2026Heterogeneous Dependency Graph-Guided Attentionfor Patent Representation Learningcited by 0
- 2026Sparse Coverage: Semantic Center Representations for Patent Prior-Art Retrievalcited by 0
- 2026From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Searchcited by 0
- 2026From Rules to Neural Graphs: Scalable Structured Prediction for Patent Prior Art Search1 Oct 2026
- 2026Sparse Coverage: Semantic Center Representations for Patent Prior-Art Retrieval31 Jul 2026
- 2026Heterogeneous Dependency Graph-Guided Attentionfor Patent Representation Learning11 May 2026
- 2026Citation-Driven Multi-View Training for Patent Embeddings: QaECTER and Sophia-Bench24 Apr 2026