mlsanityData to 14 Oct 2026

H2LooP Telecom Model v1: From Telecom Comprehension to Autonomous Issue and PR Resolution

arXiv 2609.22241 ↗First posted 4 Sep 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

We present H2LooP Telecom Model v1, a domain-specialized large language models fine-tuned for the telecommunications industry. We release two domain-adapted model variants serving complementary use cases: a comprehension-focused variant for telecom domain question answering and reasoning, and an agentic variant for autonomous telecom code generation, pull request resolution, and code commits on production repositories. H2LooP Telecom achieves strong results on the GSMA Open Telecom Lite (OT-Lite) benchmark and a proprietary telecom code generation benchmark, outperforming frontier closed-source models such as GPT-5 and Claude Opus on independent leaderboard evaluation, while preserving general-purpose capabilities. The Comprehension variant achieves 81.8% weighted average on OT-Lite Pass@3, and, independently, ranks 5th overall on the official community-run Open Telco AI Leaderboard* at only 31B parameters-ahead of frontier closed-source systems including Claude Opus 4.6, GPT-5, Gemini 3 Flash, Grok-4-fast, and Kimi K2.5. Our agentic variant obtains a relative improvement of +8.8% in AST Similarity and +20.0% in Location IoU over the base model on telecom code generation, while maintaining identical MMLU (74.0%) and BFCL v3 multi-turn function calling (79.0%) performance, indicating zero catastrophic forgetting. Domain specialization on curated telecom corpora, spanning 3GPP standards, O-RAN specifications, network telemetry, and real repository commits, yields substantial improvements over general-purpose models of equivalent scale, approaches frontier closed-source models on domain-specific evaluation, and is independently corroborated by our official leaderboard standing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 34 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

6 of 34 references.

References · 6

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  5. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Telecom Language Models: Must They Be Large?
  2. 2026Telco-GAIA: Bilingual Benchmark for Agents in Telecom Domain
  3. 2026TelecomGPT-R1: Unified Post-Training for Reasoning Across Heterogeneous Telecom Tasks
  4. 2025Evaluating Open-Source Large Language Models for Technical Telecom Question Answering
  5. 2026TelecomGPT-R1: A Unified Open-Source Reasoner for the Telecom Stack
  6. 2025Think Less, Label Better: Multi-Stage Domain-Grounded Synthetic Data Generation for Fine-Tuning Large Language Models in Telecommunications
  7. 2025TeleMoM: Consensus-Driven Telecom Intelligence via Mixture of Models ↗
  8. 2025TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solving