mlsanityData to 14 Oct 2026

T-VEC: A Telecom-Specific Vectorization Model with Enhanced Semantic Understanding via Deep Triplet Loss Fine-Tuning

arXiv 2504.16460 ↗First posted 23 Apr 2025cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

The specialized vocabulary and nuanced concepts of the telecommunications industry pose persistent challenges for standard Natural Language Processing (NLP) models. Generic embedding models often struggle to represent telecom-specific semantics, limiting their utility in retrieval and downstream tasks. We present T-VEC (Telecom Vectorization Model), a domain-adapted embedding model fine-tuned from the gte-Qwen2-1.5B-instruct backbone using a triplet loss objective. Fine-tuning was performed on T-Embed, a high-quality, large-scale dataset covering diverse telecom concepts, standards, and operational scenarios. Although T-Embed contains some proprietary material and cannot be fully released, we open source 75% of the dataset to support continued research in domain-specific representation learning. On a custom benchmark comprising 1500 query-passage pairs from IETF RFCs and vendor manuals, T-VEC surpasses MPNet, BGE, Jina and E5, demonstrating superior domain grounding and semantic precision in telecom-specific retrieval. Embedding visualizations further showcase tight clustering of telecom-relevant concepts. We release T-VEC and its tokenizer to support semantically faithful NLP applications within the telecom domain.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 23 Apr 2025.

Builds on

18 of 31 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2023Qwen Technical Reportcited by 3,344
  4. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  6. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  7. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  8. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
  9. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  10. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
  11. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  12. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
6 more
  1. 2022MTEB: Massive Text Embedding Benchmarkcited by 640
  2. 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 333
  3. 2024Greenback Bears and Fiscal Hawks: Finance is a Jungle and Text Embeddings Must Adaptcited by 12
  4. 2024PhysBERT: A Text Embedding Model for Physics Scientific Literaturecited by 8
  5. 2017Learning Domain-Specific Word Embeddings from Sparse Cybersecurity Textscited by 3
  6. 2024Investigating Distributions of Telecom Adapted Sentence Embeddings for Document Retrievalcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.