mlsanityData to 7 Oct 2026

Spec2COBOLRot: An Agentic-AI Degradation Loop for Realistic COBOL Corpus Generation

arXiv 2609.26835 ↗First posted 21 Sep 2026cs.SE cs.AIcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

COBOL remains widely deployed, yet representative corpora reflecting real production code are rarely available, limiting rigorous benchmarking of modernization approaches. We propose a systematic agentic AI pipeline for generating realistic COBOL programs, combining specification-driven generation with iterative degradation guided by patterns and complexity targets extracted from real production code. Here, realism is understood as structural fidelity to production code as captured by our metrics. We evaluate whether degradation reaches target complexity levels while preserving business behavior, and examine the limits of the approach, across three programs from distinct business domains. Results show the pipeline reliably produces syntactically valid programs and moves them toward realistic structural complexity. However, preserving business behavior is not always achieved by construction, and targeting structural metrics independently of business logic risks producing programs whose complexity does not reflect a plausible maintenance history. We discuss these limitations and outline a more realistic alternative as a direction for future work, generating legacy programs from scratch along a simulated development history.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 21 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

7 of 21 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Enhancing COBOL Code Explanations: A Multi-Agents Approach Using Large Language Models2 Jul

Other references · 6

  1. 2024Training Language Models on Synthetic Edit Sequences Improves Code Synthesiscited by 7
  2. 2025Automated Testing of COBOL to Java Transformationcited by 4
  3. 2021Contemporary COBOL: Developers' Perspectives on Defects and Defect Locationcited by 3
  4. 2022OpenCBS: An Open-Source COBOL Defects Benchmark Suitecited by 2
  5. 2025Quality Evaluation of COBOL to Java Code Transformationcited by 2
  6. 2025Impact of Comments on LLM Comprehension of Legacy Codecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AI-Generated Smells: An Analysis of Code and Architecture in LLM and Agent-Driven Development
  2. 2026AgentModernize: Preserving Business Logic in Legacy Modernization with Multi-Agent LLMs and Behavioral Specification Graphs
  3. 2026How Fast Do Agents Rot? An Empirical Study of Long-Horizon Degradation in LLM Agents for Production Decision-Making
  4. 2026OrgForge: A Multi-Agent Simulation Framework for Verifiable Synthetic Corporate Corpora
  5. 2026ττ-Bench: An Environment for End-To-End, Realistic Agent Construction
  6. 2026Constraint Decay: The Fragility of LLM Agents in Backend Code Generation
  7. 2026From Translation to Superset: Benchmark-Driven Evolution of a Production AI Agent from Rust to Python
  8. 2026Assistance to Autonomy: A Systematic Literature Review of Agentic AI across the Software Development Life Cycle