mlsanityData to 14 Oct 2026

GreenLeaf Law Embed Tiny: A Compact Embedding Model for Legal Domain Retrieval

arXiv 2608.24936 ↗First posted 23 Aug 2026cs.LG cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We present GreenLeaf Law Embed Tiny, a 0.6B parameter embedding model for legal domain retrieval. GreenLeaf-Tiny achieves 75.11% on the Massive Legal Embedding Benchmark (MLEB) and 64.38% on MTEB(Law, v1),demonstrating competitive performance among models under 1B parameters. Our approach combines a two-stage training pipeline that first distills knowledge from a larger teacher model into a compact student architecture, then applies domain-specific fine-tuning with hard negative mining; a carefully curated dataset of 3.4 million query-passage pairs, including 150,000 human-curated samples across diverse legal jurisdictions; and an efficient inference architecture supporting multiple quantization levels (BF16, INT8, binary) enabling deployment in resource-constrained environments. We provide detailed analysis of our training methodology, architectural choices, and comprehensive evaluation across legal retrieval tasks. Our results demonstrate that domain-specific training with high-quality data can improve performance for specialized domain applications

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

14 of 22 references.

References · 14

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  6. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  7. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  8. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
  9. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  10. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  11. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
  12. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
2 more
  1. 2020Contrastive Learning with Hard Negative Samplescited by 628
  2. 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 413

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Legal RAG Bench: an end-to-end benchmark for legal RAG
  2. 2024Unlocking Legal Knowledge with Multi-Layered Embedding-Based Retrieval
  3. 2026Legal2LogicICL: Improving Generalization in Transforming Legal Cases to Logical Formulas via Diverse Few-Shot Learning
  4. 2024DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment
  5. 2026Quecto-V1: Empirical Analysis of 8-bit Quantized Small Language Models for On-Device Legal Retrieval
  6. 2025Towards Reliable Retrieval in RAG Systems for Large Legal Datasets
  7. 2025Scaling Legal AI: Benchmarking Mamba and Transformers for Statutory Classification and Case Law Retrieval
  8. 2025NOWJ@COLIEE 2025: A Multi-stage Framework Integrating Embedding Models and Large Language Models for Legal Retrieval and Entailment