MLIR: A Compiler Infrastructure for the End of Moore's Law
Not on the map. Why?
Abstract (arXiv)
This work presents MLIR, a novel approach to building reusable and extensible compiler infrastructure. MLIR aims to address software fragmentation, improve compilation for heterogeneous hardware, significantly reduce the cost of building domain specific compilers, and aid in connecting existing compilers together. MLIR facilitates the design and implementation of code generators, translators and optimizers at different levels of abstraction and also across application domains, hardware targets and execution environments. The contribution of this work includes (1) discussion of MLIR as a research artifact, built for extension and evolution, and identifying the challenges and opportunities posed by this novel design point in design, semantics, optimization specification, system, and engineering. (2) evaluation of MLIR as a generalized infrastructure that reduces the cost of building compilers-describing diverse use-cases to show research and educational opportunities for future programming languages, compilers, execution environments, and computer architecture. The paper also presents the rationale for MLIR, its original design principles, structures and semantics.
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 6; 2023: 12; 2024: 7; 2025: 14; 2026: 17.
64 papers.
Sort:
By area:
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2023On the Tool Manipulation Capability of Open-source Large Language Modelscited by 122
- 2021DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusioncited by 56
- 2025Astra: A Multi-Agent System for GPU Kernel Performance Optimizationcited by 46
- 2021tf.data: A Machine Learning Data Processing Frameworkcited by 40
- 2023Zero Bubble Pipeline Parallelismcited by 39
- 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 38
- 2022GraphQ IR: Unifying the Semantic Parsing of Graph Query Languages with One Intermediate Representationcited by 13
- 2022Query Processing on Tensor Computation Runtimescited by 12
- 2023XLB: A differentiable massively parallel lattice Boltzmann library in Pythoncited by 11
- 2026AscendKernelGen: A Systematic Study of LLM-Based Kernel Generation for Neural Processing Unitscited by 11
- 2024Architectural Neural Backdoors from First Principlescited by 10
38 more
- 2022Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutationcited by 9
- 2023oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilationcited by 7
- 2022Special Session: Towards an Agile Design Methodology for Efficient, Reliable, and Secure ML Systemscited by 6
- 2025Batch Query Processing and Optimization for Agentic Workflowscited by 6
- 2021A Highly Configurable Hardware/Software Stack for DNN Inference Accelerationcited by 4
- 2024UniSparse: An Intermediate Language for General Sparse Format Customizationcited by 4
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidancecited by 4
- 2021A Data-Centric Optimization Framework for Machine Learningcited by 3
- 2022Memory Planning for Deep Neural Networkscited by 3
- 2023CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programscited by 3
- 2025GPU Kernel Optimization Beyond Full Builds: An LLM Framework with Minimal Executable Programscited by 3
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Metacited by 3
- 2026A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimizationcited by 3
- 2021Automated Backend-Aware Post-Training Quantizationcited by 2
- 2023Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platformcited by 2
- 2024Productively Deploying Emerging Models on Emerging Platforms: A Top-Down Approach for Testing and Debuggingcited by 2
- 2026Hexagon-MLIR: An AI Compilation Stack For Qualcomm's Neural Processing Units (NPUs)cited by 2
- 2021Joint Program and Layout Transformations to enable Convolutional Operators on Specialized Hardware based on Constraint Programmingcited by 1
- 2023OpenHLS: High-Level Synthesis for Low-Latency Deep Neural Networks for Experimental Sciencecited by 1
- 2023ACRoBat: Optimizing Auto-batching of Dynamic Deep Learning at Compile Timecited by 1
- 2023Tackling the Matrix Multiplication Micro-kernel Generation with Exocited by 1
- 2024vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUscited by 1
- 2024DSP-MLIR: A MLIR Dialect for Digital Signal Processingcited by 1
- 2024Obsidian: Cooperative State-Space Exploration for Performant Inference on Secure ML Acceleratorscited by 1
- 2025DiTOX: Fault Detection and Localization in the ONNX Optimizercited by 1
- 2025Kolmogorov-Arnold Energy Models: Fast, Interpretable Generative Modelingcited by 1
- 2025GraphMend: Code Transformations for Fixing Graph Breaks in PyTorch 2cited by 1
- 2025HipKittens: Fast and Furious AMD Kernelscited by 1
- 2025SkyEgg: Heterogeneity-Aware Hardware Synthesis via Equality Saturationcited by 1
- 2026BluTrain: A C++/CUDA Framework for AI Systemscited by 1
- 2022Compiler-Driven Simulation of Reconfigurable Hardware Acceleratorscited by 0
- 2023CMLCompiler: A Unified Compiler for Classical Machine Learningcited by 0
- 2023Exploring Robustness of Image Recognition Models on Hardware Acceleratorscited by 0
- 2023GEVO-ML: Optimizing Machine Learning Code with Evolutionary Computationcited by 0
- 2024PolyTOPS: Reconfigurable and Flexible Polyhedral Schedulercited by 0
- 2025Morphing-based Compression for Data-centric ML Pipelinescited by 0
- 2025Rulebook: bringing co-routines to reinforcement learning environmentscited by 0
- 2025Accelerating GenAI Workloads by Enabling RISC-V Microkernel Support in IREEcited by 0
50 most cited of 64 All 64 (JSON)
- 2026AI as a Compiler: Compiling Triton kernels without the Triton compiler29 Sep 2026
- 2026MQSS-Selector: RL-Guided Pass Selection for an MLIR Compilation Pipeline24 Sep 2026
- 2026Can Large Language Models Recover Semantic Optimization Opportunities That Compilers Miss?4 Aug 2026
- 2026An MLIR-Based Compilation Method for Large Language Models17 Jul 2026
- 2026From Intent to Infrastructure: LLM-Driven Agent Compilers for ISAC Networks7 Jul 2026
- 2026BluTrain: A C++/CUDA Framework for AI Systems23 Jun 2026
- 2026Mojo: A Promising Tool for Scalable Financial AI Efficiency14 Jun 2026
- 2026Toward Compiler World Models: Learning Latent Dynamics for Efficient Tensor Program Search8 Jun 2026
- 2026Cross-Dialect Generalization Without Retraining: Benchmarks and Evaluation of Schema-Derived Constrained Decoding for MLIR14 May 2026
- 2026Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels16 Apr 2026
- 2026From LLM to Silicon: RL-Driven ASIC Architecture Exploration for On-Device AI Inference8 Apr 2026
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidance30 Mar 2026
38 more
- 2026Hexagon-MLIR: An AI Compilation Stack For Qualcomm's Neural Processing Units (NPUs)23 Feb 2026
- 2026Analyzing Latency Hiding and Parallelism in an MLIR-based AI Kernel Compiler22 Feb 2026
- 2026A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization19 Jan 2026
- 2026AscendKernelGen: A Systematic Study of LLM-Based Kernel Generation for Neural Processing Units12 Jan 2026
- 2026Hardware-Aware Reformulation of Convolutions for Efficient Execution on Specialized AI Hardware: A Case Study on NVIDIA Tensor Cores9 Jan 2026
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta29 Dec 2025
- 2025XTC, A Research Platform for Optimizing AI Workload Operators18 Dec 2025
- 2025GPU Kernel Optimization Beyond Full Builds: An LLM Framework with Minimal Executable Programs15 Dec 2025
- 2025SkyEgg: Heterogeneity-Aware Hardware Synthesis via Equality Saturation19 Nov 2025
- 2025HipKittens: Fast and Furious AMD Kernels11 Nov 2025
- 2025LightCode: Compiling LLM Inference for Photonic-Electronic Systems19 Sep 2025
- 2025GraphMend: Code Transformations for Fixing Graph Breaks in PyTorch 217 Sep 2025
- 2025Astra: A Multi-Agent System for GPU Kernel Performance Optimization9 Sep 2025
- 2025Batch Query Processing and Optimization for Agentic Workflows2 Sep 2025
- 2025Accelerating GenAI Workloads by Enabling RISC-V Microkernel Support in IREE7 Jul 2025
- 2025Kolmogorov-Arnold Energy Models: Fast, Interpretable Generative Modeling17 Jun 2025
- 2025DiTOX: Fault Detection and Localization in the ONNX Optimizer3 May 2025
- 2025Rulebook: bringing co-routines to reinforcement learning environments28 Apr 2025
- 2025Morphing-based Compression for Data-centric ML Pipelines15 Apr 2025
- 2024Obsidian: Cooperative State-Space Exploration for Performant Inference on Secure ML Accelerators4 Sep 2024
- 2024DSP-MLIR: A MLIR Dialect for Digital Signal Processing20 Aug 2024
- 2024vMCU: Coordinated Memory Management and Kernel Optimization for DNN Inference on MCUs1 May 2024
- 2024Productively Deploying Emerging Models on Emerging Platforms: A Top-Down Approach for Testing and Debugging14 Apr 2024
- 2024UniSparse: An Intermediate Language for General Sparse Format Customization9 Mar 2024
- 2024Architectural Neural Backdoors from First Principles10 Feb 2024
- 2024PolyTOPS: Reconfigurable and Flexible Polyhedral Scheduler12 Jan 2024
- 2023Zero Bubble Pipeline Parallelism30 Nov 2023
- 2023XLB: A differentiable massively parallel lattice Boltzmann library in Python27 Nov 2023
- 2023CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programs16 Nov 2023
- 2023Tackling the Matrix Multiplication Micro-kernel Generation with Exo26 Oct 2023
- 2023GEVO-ML: Optimizing Machine Learning Code with Evolutionary Computation16 Oct 2023
- 2023Exploring Robustness of Image Recognition Models on Hardware Accelerators2 Jun 2023
- 2023On the Tool Manipulation Capability of Open-source Large Language Models25 May 2023
- 2023ACRoBat: Optimizing Auto-batching of Dynamic Deep Learning at Compile Time17 May 2023
- 2023Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform16 Feb 2023
- 2023OpenHLS: High-Level Synthesis for Low-Latency Deep Neural Networks for Experimental Science13 Feb 2023
- 2023CMLCompiler: A Unified Compiler for Classical Machine Learning31 Jan 2023
- 2023oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation3 Jan 2023
50 newest of 64 All 64 (JSON)
- 2025Astra: A Multi-Agent System for GPU Kernel Performance Optimizationcited by 46
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidancecited by 4
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Metacited by 3
- 2026From Intent to Infrastructure: LLM-Driven Agent Compilers for ISAC Networkscited by 0
- 2026From Intent to Infrastructure: LLM-Driven Agent Compilers for ISAC Networks7 Jul 2026
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidance30 Mar 2026
- 2025KernelEvolve: Scaling Agentic Kernel Coding for Heterogeneous AI Accelerators at Meta29 Dec 2025
- 2025Astra: A Multi-Agent System for GPU Kernel Performance Optimization9 Sep 2025
- 2021Pruning and Quantization for Deep Neural Network Acceleration: A Surveycited by 259
- 2023On the Tool Manipulation Capability of Open-source Large Language Modelscited by 122
- 2021DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusioncited by 56
- 2021tf.data: A Machine Learning Data Processing Frameworkcited by 40
- 2023Zero Bubble Pipeline Parallelismcited by 39
- 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 38
- 2022GraphQ IR: Unifying the Semantic Parsing of Graph Query Languages with One Intermediate Representationcited by 13
- 2022Query Processing on Tensor Computation Runtimescited by 12
- 2023XLB: A differentiable massively parallel lattice Boltzmann library in Pythoncited by 11
- 2026AscendKernelGen: A Systematic Study of LLM-Based Kernel Generation for Neural Processing Unitscited by 11
- 2024Architectural Neural Backdoors from First Principlescited by 10
- 2022Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutationcited by 9
12 most cited of 57 All 57 (JSON)
- 2026AI as a Compiler: Compiling Triton kernels without the Triton compiler29 Sep 2026
- 2026MQSS-Selector: RL-Guided Pass Selection for an MLIR Compilation Pipeline24 Sep 2026
- 2026Can Large Language Models Recover Semantic Optimization Opportunities That Compilers Miss?4 Aug 2026
- 2026An MLIR-Based Compilation Method for Large Language Models17 Jul 2026
- 2026BluTrain: A C++/CUDA Framework for AI Systems23 Jun 2026
- 2026Mojo: A Promising Tool for Scalable Financial AI Efficiency14 Jun 2026
- 2026Cross-Dialect Generalization Without Retraining: Benchmarks and Evaluation of Schema-Derived Constrained Decoding for MLIR14 May 2026
- 2026Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels16 Apr 2026
- 2026From LLM to Silicon: RL-Driven ASIC Architecture Exploration for On-Device AI Inference8 Apr 2026
- 2026Hexagon-MLIR: An AI Compilation Stack For Qualcomm's Neural Processing Units (NPUs)23 Feb 2026
- 2026Analyzing Latency Hiding and Parallelism in an MLIR-based AI Kernel Compiler22 Feb 2026
- 2026A Two-Stage GPU Kernel Tuner Combining Semantic Refactoring and Search-Based Optimization19 Jan 2026
12 newest of 57 All 57 (JSON)