mlsanityData to 7 Oct 2026

ECCO: Evidence-Driven Causal Reasoning for Compiler Optimization

arXiv 2602.00087 ↗First posted 23 Jan 2026cs.LG cs.AI cs.PFcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Compiler auto-tuning faces a dichotomy between traditional black-box search methods, which lack semantic guidance, and recent Large Language Model (LLM) approaches, which often suffer from superficial pattern matching and causal opacity. In this paper, we introduce ECCO, a framework that bridges interpretable reasoning with combinatorial search. We first propose a reverse engineering methodology to construct a Chain-of-Thought dataset, explicitly mapping static code features to verifiable performance evidence. This enables the model to learn the causal logic governing optimization decisions rather than merely imitating sequences. Leveraging this interpretable prior, we design a collaborative inference mechanism where the LLM functions as a strategist, defining optimization intents that dynamically guide the mutation operations of a genetic algorithm. Experimental results on seven datasets demonstrate that ECCO significantly outperforms the LLVM opt -O3 baseline, achieving an average 24.44% reduction in cycles.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 12 of its 37 references that are in the map. First posted on arXiv 23 Jan 2026.

Builds on

12 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024OpenAI o1 System Card21 Dec

Other references · 11

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  3. 2025Kimi K2: Open Agentic Intelligencecited by 523
  4. 2024Meta Large Language Model Compiler: Foundation Models of Compiler Optimizationcited by 39
  5. 2025Compiler-R1: Towards Agentic Compiler Auto-tuning with Reinforcement Learningcited by 7
  6. 2024CompilerDream: Learning a Compiler World Model for General Code Optimizationcited by 6
  7. 2025AwareCompiler: Agentic Context-Aware Compiler Optimization via a Synergistic Knowledge-Data Driven Frameworkcited by 4
  8. 2025REASONING COMPILER: LLM-Guided Optimizations for Efficient Model Servingcited by 3
  9. 2025GRACE: Cluster-Specific Sequence Reuse for Compiler Auto-Tuningcited by 1
  10. 2025Synergy-Guided Compiler Auto-Tuning of Nested LLVM Pass Pipelinescited by 1
  11. 2025A Hybrid, Knowledge-Guided Evolutionary Framework for Personalized Compiler Auto-Tuningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026HintPilot: LLM-based Compiler Hint Synthesis for Code Optimization
  2. 2026AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning
  3. 2023Large Language Models for Compiler Optimization
  4. 2026LiteCoOp: Lightweight Multi-LLM Shared-Tree Reasoning for Model-Serving Compiler Optimizations
  5. 2026Magellan: Autonomous Discovery of Novel Compiler Optimization Heuristics with AlphaEvolve
  6. 2026Understanding Agent-Based Patching of Compiler Missed Optimizations
  7. 2024Should AI Optimize Your Code? A Comparative Study of Classical Optimizing Compilers Versus Current Large Language Models
  8. 2025LPO: Discovering Missed Peephole Optimizations with Large Language Models