mlsanityData to 14 Oct 2026

NetLLM: Adapting Large Language Models for Networking

arXiv 2402.02338 ↗First posted 4 Feb 2024cs.NI cs.LGcited by 78

Not on the map. Why?

Abstract (arXiv)

Many networking tasks now employ deep learning (DL) to solve complex prediction and optimization problems. However, current design philosophy of DL-based algorithms entails intensive engineering overhead due to the manual design of deep neural networks (DNNs) for different networking tasks. Besides, DNNs tend to achieve poor generalization performance on unseen data distributions/environments. Motivated by the recent success of large language models (LLMs), this work studies the LLM adaptation for networking to explore a more sustainable design philosophy. With the powerful pre-trained knowledge, the LLM is promising to serve as the foundation model to achieve "one model for all tasks" with even better performance and stronger generalization. In pursuit of this vision, we present NetLLM, the first framework that provides a coherent design to harness the powerful capabilities of LLMs with low efforts to solve networking problems. Specifically, NetLLM empowers the LLM to effectively process multimodal data in networking and efficiently generate task-specific answers. Besides, NetLLM drastically reduces the costs of fine-tuning the LLM to acquire domain knowledge for networking. Across three networking-related use cases - viewport prediction, adaptive bitrate streaming and cluster job scheduling, we showcase that the NetLLM-adapted LLM significantly outperforms state-of-the-art algorithms.

Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). Builds on 51 of its 111 references that are in the map. First posted on arXiv 4 Feb 2024.

Builds on

51 of 111 references.

References · 51

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  9. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  10. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  11. 2016Layer Normalizationcited by 5,669
  12. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
38 more
  1. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  2. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  3. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  6. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  8. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  9. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  10. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  11. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  12. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
  13. 2019Relational Knowledge Distillationcited by 889
  14. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
  15. 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
  16. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
  17. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  18. 2019Improved Knowledge Distillation via Teacher Assistantcited by 573
  19. 2022Improving alignment of dialogue agents via targeted human judgementscited by 531
  20. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
  21. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
  22. 2023Explainability for Large Language Models: A Surveycited by 333
  23. 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 254
  24. 2023Large Language Models in Finance: A Surveycited by 226
  25. 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
  26. 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 141
  27. 2018Learning Scheduling Algorithms for Data Processing Clusterscited by 134
  28. 2017Device Placement Optimization with Reinforcement Learningcited by 86
  29. 2022ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classificationcited by 66
  30. 2022Advancing Model Pruning via Bi-level Optimizationcited by 56
  31. 2022Mixed-Precision Neural Network Quantization via Learned Layer-wise Importancecited by 54
  32. 2020Discrimination-aware Network Pruning for Deep Model Compressioncited by 51
  33. 2022An Efficient Memory-Augmented Transformer for Knowledge-Intensive NLP Taskscited by 36
  34. 2023netFound: Principled Design for Network Foundation Modelscited by 17
  35. 2022Automatic Curriculum Generation for Learning Adaptation in Networkingcited by 15
  36. 2019DL2: A Deep Learning-driven Scheduler for Deep Learning Clusterscited by 14
  37. 2013Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scalecited by 9
  38. 2019Pano: Optimizing 360deg Video Streaming with a Better Understanding of Quality Perceptioncited by 8

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 37; 2026: 33.

78 papers.

Sort:

By area:

  1. 2024Large Model Based Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trendscited by 26
  2. 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
  3. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  4. 2024SCALM: Towards Semantic Caching for Automated Chat Services with Large Language Modelscited by 16
  5. 2024Large Language Models for Networking: Workflow, Advances and Challengescited by 15
  6. 2024CATP-LLM: Empowering Large Language Models for Cost-Aware Tool Planningcited by 14
  7. 2025Large Language Models for Wireless Communications: From Adaptation to Autonomycited by 11
  8. 2025Incident Response Planning Using a Lightweight Large Language Model with Reduced Hallucinationcited by 10
  9. 2026Agentic AI Empowered Intent-Based Networking for 6Gcited by 7
  10. 2026WirelessAgent++: Automated Agentic Workflow Design and Benchmarking for Wireless Networkscited by 7
  11. 2025MoE2: Optimizing Collaborative Inference for Edge Large Language Modelscited by 6
  12. 2024LightLLM: A Versatile Large Language Model for Predictive Light Sensingcited by 5
38 more
  1. 2025FOVA: Offline Federated Reinforcement Learning with Mixed-Quality Datacited by 5
  2. 2026NetAgentBench: A State-Centric Benchmark for Evaluating Agentic Network Configurationcited by 5
  3. 2025Satellite Edge Artificial Intelligence with Large Models: Architectures and Technologiescited by 4
  4. 2025Respond to Change with Constancy: Instruction-tuning with LLM for Non-I.I.D. Network Traffic Classificationcited by 4
  5. 2026SADE: Symptom-Aware Diagnostic Escalation for LLM-Based Network Troubleshootingcited by 4
  6. 2025On-Device LLM for Context-Aware Wi-Fi Roamingcited by 3
  7. 2025Cost-Efficient LLM Training with Lifetime-Aware Tensor Offloading via GPUDirect Storagecited by 3
  8. 2025A Satellite-Ground Synergistic Large Vision-Language Model System for Earth Observationcited by 3
  9. 20266GAgentGym: Tool Use, Data Synthesis, and Agentic Learning for Network Managementcited by 3
  10. 2026DarwinNet: An Evolutionary Network Architecture for Agent-Driven Protocol Synthesiscited by 3
  11. 2025Edge Large AI Models: Revolutionizing 6G Networkscited by 2
  12. 2025AI2MMUM: AI-AI Oriented Multi-Modal Universal Model Leveraging Telecom Domain Large Modelcited by 2
  13. 2025From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communicationscited by 2
  14. 2025Pegasus: A Universal Framework for Scalable Deep Learning Inference on the Dataplanecited by 2
  15. 2025Beyond Interpretability: Exploring the Comprehensibility of Adaptive Video Streaming through Large Language Modelscited by 2
  16. 2026Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Modelscited by 2
  17. 2026Rollout-Training Co-Design for Efficient LLM-Based Multi-Agent Reinforcement Learningcited by 2
  18. 2026PLUME: Building a Network-Native Foundation Model for Wireless Traces via Protocol-Aware Tokenizationcited by 2
  19. 2026A Family of Open Time-Series Foundation Models for the Radio Access Networkcited by 2
  20. 2026Large Language Models for Agentic NetOps and AIOps: Architectures, Evaluation, and Safetycited by 2
  21. 2026CENTILE: A Telemetry Foundation Model Evaluated by the Decisions It Drivescited by 2
  22. 2024MERLOT: A Distilled LLM-based Mixture-of-Experts Framework for Scalable Encrypted Traffic Classificationcited by 1
  23. 2025Distilling Large Language Models for Network Active Queue Managementcited by 1
  24. 2025LLMs' Suitability for Network Security: A Case Study of STRIDE Threat Modelingcited by 1
  25. 2025OFCnetLLM: Large Language Model for Network Monitoring and Alertnesscited by 1
  26. 2025SignalLLM: A General-Purpose LLM Agent Framework for Automated Signal Processingcited by 1
  27. 2025Bridging Language Models and Formal Methods for Intent-Driven Optical Network Designcited by 1
  28. 2025Understanding Network Behaviors through Natural Language Question-Answeringcited by 1
  29. 2026Hallucination-Resistant Security Planning with a Large Language Modelcited by 1
  30. 2026BeamAgent: LLM-Aided MIMO Beamforming with Decoupled Intent Parsing and Alternating Optimization for Joint Site Selection and Precodingcited by 1
  31. 2026Cloud-Edge Collaborative Large Models for Robust Photovoltaic Power Forecastingcited by 1
  32. 2026Validated Intent Compilation for Constrained Routing in LEO Mega-Constellationscited by 1
  33. 2026EMA: Efficient Model Adaptation for Learning-based Systemscited by 1
  34. 2026PropLLM: Propagation-Aware Scene Reconstruction for Network Fault Diagnosiscited by 1
  35. 2026OmniPlan: An Adaptive Framework for Timely and Near-Optimal Network Planning Optimizationcited by 1
  36. 2026LUCID: An Agentic AI Framework on Digital-Twin in the Loop for QoS-Guaranteeing Robotic Controlcited by 1
  37. 2026TelecomGPT-R1: Unified Post-Training for Reasoning Across Heterogeneous Telecom Taskscited by 1
  38. 2026System One Models for Wireless Decision-Making:Applications and Performance Evaluationcited by 1

50 most cited of 78 All 78 (JSON)