mlsanityData to 7 Oct 2026

Compass-Embedding v4: Robust Contrastive Learning for Multilingual E-commerce Embeddings

arXiv 2601.11565 ↗First posted 25 Dec 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As global e-commerce rapidly expands into emerging markets, the lack of high-quality semantic representations for low-resource languages has become a decisive bottleneck for retrieval, recommendation, and search systems. In this work, we present Compass-Embedding v4, a high-efficiency multilingual embedding framework specifically optimized for Southeast Asian (SEA) e-commerce scenarios, where data scarcity, noisy supervision, and strict production constraints jointly challenge representation learning. Compass-Embedding v4 addresses three core challenges. First, large-batch contrastive training under mixed task supervision introduces systematic false negatives that degrade semantic alignment. We propose Class-Aware Masking (CAM), a lightweight modification to the InfoNCE objective that suppresses invalid in-batch negatives and improves semantic discrimination without altering training efficiency. Second, low-resource SEA languages suffer from limited and uneven data coverage. We construct a diversified training corpus through context-grounded synthetic data generation, cross-lingual translation, and structured e-commerce data construction, enabling robust multilingual and domain-specific learning. Third, production deployment requires high-throughput inference while preserving embedding quality. We combine robustness-driven large-batch training with spherical model merging to mitigate catastrophic forgetting, and optimize inference via vLLM and FP8 quantization. Extensive evaluations across multilingual benchmarks and proprietary e-commerce tasks show that Compass-Embedding v4 achieves state-of-the-art performance on major SEA languages, significantly outperforming general-purpose embedding models in domain-specific retrieval and classification, while maintaining competitive performance on high-resource languages.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 25 Dec 2025.

Builds on

13 of 17 references.

References · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  6. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
  7. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  8. 2023Improving Text Embeddings with Large Language Modelscited by 295
  9. 2024Generative Representational Instruction Tuningcited by 227
  10. 2021Scaling Deep Contrastive Learning Batch Size under Memory Limited Setupcited by 123
  11. 2024Leveraging Passage Embeddings for Efficient Listwise Reranking with Large Language Modelscited by 20
  12. 2024LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendationcited by 18
1 more
  1. 2024Improving General Text Embedding Model: Tackling Task Conflict and Data Imbalance through Model Mergingcited by 14

Built on by

Not cited yet.