mlsanityData to 14 Oct 2026

RESCORE: LLM-Driven Simulation Recovery in Control Systems Research Papers

arXiv 2604.04324 ↗First posted 6 Apr 2026cs.AI cs.SEcited by 1

Not on the map. Why?

Abstract (arXiv)

Reconstructing numerical simulations from control systems research papers is often hindered by underspecified parameters and ambiguous implementation details. We define the task of Paper to Simulation Recoverability, the ability of an automated system to generate executable code that faithfully reproduces a paper's results. We curate a benchmark of 500 papers from the IEEE Conference on Decision and Control (CDC) and propose RESCORE, a three component LLM agentic framework, Analyzer, Coder, and Verifier. RESCORE uses iterative execution feedback and visual comparison to improve reconstruction fidelity. Our method successfully recovers task coherent simulations for 40.7% of benchmark instances, outperforming single pass generation. Notably, the RESCORE automated pipeline achieves an estimated 10X speedup over manual human replication, drastically cutting the time and effort required to verify published control methodologies. We will release our benchmark and agents to foster community progress in automated research replication.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

23 of 33 references.

References · 23

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2021Program Synthesis with Large Language Modelscited by 3,637
  5. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  8. 2023Teaching Large Language Models to Self-Debugcited by 988
  9. 2021Measuring Coding Challenge Competence With APPScited by 902
  10. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  11. 2023RepoBench: Benchmarking Repository-Level Code Auto-Completion Systemscited by 353
  12. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
11 more
  1. 2023Nougat: Neural Optical Understanding for Academic Documentscited by 245
  2. 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
  3. 2024RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learningcited by 151
  4. 2025SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agentscited by 142
  5. 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
  6. 2025Paper2Code: Automating Code Generation from Scientific Papers in Machine Learningcited by 70
  7. 2025UTBoost: Rigorous Evaluation of Coding Agents on SWE-Benchcited by 45
  8. 2021VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groupscited by 27
  9. 2021Data-Driven Reachability Analysis with Christoffel Functionscited by 12
  10. 2023On the Safety of Connected Cruise Control: Analysis and Synthesis with Control Barrier Functionscited by 2
  11. 2023In-class Data Analysis Replications: Teaching Students while Testing Sciencecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Repair or Resample? Rethinking Failure Debugging in LLM Multi-Agent Systems
  2. 2026Chronicle: Cut-Point Replay for Regression Testing of LLM Agents
  3. 2026Agentic Scientific Simulation: Execution-Grounded Model Construction and Reconstruction
  4. 2025Crucible: Quantifying the Potential of Control Algorithms through LLM Agents
  5. 2026Frontier: Towards Comprehensive and Accurate LLM Inference Simulation
  6. 2026AgentRewind: Recoverable Execution for Long-Horizon LLM Agents
  7. 2025RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedback
  8. 2026Signal Reshaping for GRPO in Weak-Feedback Agentic Code Repair