What do LLMs need to Synthesize Correct Router Configurations?
Not on the map. Why?
Abstract (arXiv)
We investigate whether Large Language Models (e.g., GPT-4) can synthesize correct router configurations with reduced manual effort. We find GPT-4 works very badly by itself, producing promising draft configurations but with egregious errors in topology, syntax, and semantics. Our strategy, that we call Verified Prompt Programming, is to combine GPT-4 with verifiers, and use localized feedback from the verifier to automatically correct errors. Verification requires a specification and actionable localized feedback to be effective. We show results for two use cases: translating from Cisco to Juniper configurations on a single router, and implementing no-transit policy on multiple routers. While human input is still required, if we define the leverage as the number of automated prompts to the number of human prompts, our experiments show a leverage of 10X for Juniper translation, and 6X for implementing no-transit policy, ending with verified configurations.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Jul 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 6; 2025: 11; 2026: 10.
29 papers.
Sort:
By area:
- 2024Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunitiescited by 83
- 2023Clover: Closed-Loop Verifiable Code Generationcited by 67
- 2024TelecomGPT: A Framework to Build Telecom-Specfic Large Language Modelscited by 40
- 2023Can Large Language Models Find And Fix Vulnerable Software?cited by 15
- 2024Large Language Models for Networking: Workflow, Advances and Challengescited by 15
- 2024GeNet: A Multimodal LLM-Based Co-Pilot for Network Topology and Configurationcited by 6
- 2025MoE2: Optimizing Collaborative Inference for Edge Large Language Modelscited by 6
- 2025Man-Made Heuristics Are Dead. Long Live Code Generators!cited by 6
- 2025INTA: Intent-Based Translation for Network Configuration with LLM Agentscited by 5
- 2025TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solvingcited by 5
- 2025Mapping the Landscape of Generative AI in Network Monitoring and Managementcited by 4
- 2024FastRAG: Retrieval Augmented Generation for Semi-structured Datacited by 3
17 more
- 2025Robust Heuristic Algorithm Design with LLMscited by 3
- 2025An LLM-based Agentic Framework for Accessible Network Controlcited by 2
- 2026Large Language Models for Agentic NetOps and AIOps: Architectures, Evaluation, and Safetycited by 2
- 2025From Connectivity to Autonomy: The Dawn of Self-Evolving Communication Systemscited by 1
- 2025Understanding Network Behaviors through Natural Language Question-Answeringcited by 1
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunicationscited by 1
- 2026Advanced LLM-Enhanced Intent-Based 5G Network Management using Dynamic Semantic Routescited by 1
- 2026NetConfArena: An Executable Benchmark for LLM Agents in Closed-Loop Network Configurationcited by 1
- 2026Uncertainty Signals for Network Intent Translation: Risk Ranking and Ambiguity Localizationcited by 1
- 2024Rephrase and Contrast: Fine-Tuning Language Models for Enhanced Understanding of Communication and Computer Networkscited by 0
- 2025BEAR: BGP Event Analysis and Reportingcited by 0
- 2025Automated Network Protocol Testing with LLM Agentscited by 0
- 2026Aether: Network Validation Using Agentic AI and Digital Twincited by 0
- 2026Can AI Agents Detect and Repair Artifact Drift in Network Experiments?cited by 0
- 2026Can AI Agents Deliver Verifiable Network-Wide Outcomes Across Authority Boundaries?cited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Can You Check That? The Checkability Boundary for Local LLM Network Automationcited by 0
- 2026Can You Check That? The Checkability Boundary for Local LLM Network Automation25 Sep 2026
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026Can AI Agents Deliver Verifiable Network-Wide Outcomes Across Authority Boundaries?9 Sep 2026
- 2026Can AI Agents Detect and Repair Artifact Drift in Network Experiments?9 Sep 2026
- 2026Uncertainty Signals for Network Intent Translation: Risk Ranking and Ambiguity Localization3 Sep 2026
- 2026NetConfArena: An Executable Benchmark for LLM Agents in Closed-Loop Network Configuration24 Aug 2026
- 2026Advanced LLM-Enhanced Intent-Based 5G Network Management using Dynamic Semantic Routes23 Aug 2026
- 2026Large Language Models for Agentic NetOps and AIOps: Architectures, Evaluation, and Safety12 May 2026
- 2026Aether: Network Validation Using Agentic AI and Digital Twin20 Apr 2026
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunications2 Jan 2026
- 2025Understanding Network Behaviors through Natural Language Question-Answering24 Oct 2025
- 2025Automated Network Protocol Testing with LLM Agents15 Oct 2025
17 more
- 2025Man-Made Heuristics Are Dead. Long Live Code Generators!9 Oct 2025
- 2025Robust Heuristic Algorithm Design with LLMs9 Oct 2025
- 2025An LLM-based Agentic Framework for Accessible Network Control24 Sep 2025
- 2025TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solving12 Jun 2025
- 2025BEAR: BGP Event Analysis and Reporting4 Jun 2025
- 2025From Connectivity to Autonomy: The Dawn of Self-Evolving Communication Systems29 May 2025
- 2025Mapping the Landscape of Generative AI in Network Monitoring and Management12 Feb 2025
- 2025MoE2: Optimizing Collaborative Inference for Edge Large Language Models16 Jan 2025
- 2025INTA: Intent-Based Translation for Network Configuration with LLM Agents15 Jan 2025
- 2024FastRAG: Retrieval Augmented Generation for Semi-structured Data21 Nov 2024
- 2024Rephrase and Contrast: Fine-Tuning Language Models for Enhanced Understanding of Communication and Computer Networks21 Sep 2024
- 2024TelecomGPT: A Framework to Build Telecom-Specfic Large Language Models12 Jul 2024
- 2024GeNet: A Multimodal LLM-Based Co-Pilot for Network Topology and Configuration11 Jul 2024
- 2024Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunities17 May 2024
- 2024Large Language Models for Networking: Workflow, Advances and Challenges19 Apr 2024
- 2023Clover: Closed-Loop Verifiable Code Generation26 Oct 2023
- 2023Can Large Language Models Find And Fix Vulnerable Software?20 Aug 2023
- 2025INTA: Intent-Based Translation for Network Configuration with LLM Agentscited by 5
- 2025An LLM-based Agentic Framework for Accessible Network Controlcited by 2
- 2026Large Language Models for Agentic NetOps and AIOps: Architectures, Evaluation, and Safetycited by 2
- 2026NetConfArena: An Executable Benchmark for LLM Agents in Closed-Loop Network Configurationcited by 1
- 2025Automated Network Protocol Testing with LLM Agentscited by 0
- 2026Aether: Network Validation Using Agentic AI and Digital Twincited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026NetConfArena: An Executable Benchmark for LLM Agents in Closed-Loop Network Configuration24 Aug 2026
- 2026Large Language Models for Agentic NetOps and AIOps: Architectures, Evaluation, and Safety12 May 2026
- 2026Aether: Network Validation Using Agentic AI and Digital Twin20 Apr 2026
- 2025Automated Network Protocol Testing with LLM Agents15 Oct 2025
- 2025An LLM-based Agentic Framework for Accessible Network Control24 Sep 2025
- 2025INTA: Intent-Based Translation for Network Configuration with LLM Agents15 Jan 2025
- 2023Clover: Closed-Loop Verifiable Code Generationcited by 67
- 2024TelecomGPT: A Framework to Build Telecom-Specfic Large Language Modelscited by 40
- 2023Can Large Language Models Find And Fix Vulnerable Software?cited by 15
- 2024Large Language Models for Networking: Workflow, Advances and Challengescited by 15
- 2024GeNet: A Multimodal LLM-Based Co-Pilot for Network Topology and Configurationcited by 6
- 2025Man-Made Heuristics Are Dead. Long Live Code Generators!cited by 6
- 2025TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solvingcited by 5
- 2025Mapping the Landscape of Generative AI in Network Monitoring and Managementcited by 4
- 2025Robust Heuristic Algorithm Design with LLMscited by 3
- 2025From Connectivity to Autonomy: The Dawn of Self-Evolving Communication Systemscited by 1
- 2025Understanding Network Behaviors through Natural Language Question-Answeringcited by 1
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunicationscited by 1
12 most cited of 19 All 19 (JSON)
- 2026Can You Check That? The Checkability Boundary for Local LLM Network Automation25 Sep 2026
- 2026Can AI Agents Deliver Verifiable Network-Wide Outcomes Across Authority Boundaries?9 Sep 2026
- 2026Can AI Agents Detect and Repair Artifact Drift in Network Experiments?9 Sep 2026
- 2026Uncertainty Signals for Network Intent Translation: Risk Ranking and Ambiguity Localization3 Sep 2026
- 2026Advanced LLM-Enhanced Intent-Based 5G Network Management using Dynamic Semantic Routes23 Aug 2026
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunications2 Jan 2026
- 2025Understanding Network Behaviors through Natural Language Question-Answering24 Oct 2025
- 2025Man-Made Heuristics Are Dead. Long Live Code Generators!9 Oct 2025
- 2025Robust Heuristic Algorithm Design with LLMs9 Oct 2025
- 2025TeleMath: A Benchmark for Large Language Models in Telecom Mathematical Problem Solving12 Jun 2025
- 2025BEAR: BGP Event Analysis and Reporting4 Jun 2025
- 2025From Connectivity to Autonomy: The Dawn of Self-Evolving Communication Systems29 May 2025
12 newest of 19 All 19 (JSON)