Tiramisu: A Polyhedral Compiler for Expressing Fast and Portable Code
Not on the map. Why?
Abstract (arXiv)
This paper introduces Tiramisu, a polyhedral framework designed to generate high performance code for multiple platforms including multicores, GPUs, and distributed machines. Tiramisu introduces a scheduling language with novel extensions to explicitly manage the complexities that arise when targeting these systems. The framework is designed for the areas of image processing, stencils, linear algebra and deep learning. Tiramisu has two main features: it relies on a flexible representation based on the polyhedral model and it has a rich scheduling language allowing fine-grained control of optimizations. Tiramisu uses a four-level intermediate representation that allows full separation between the algorithms, loop transformations, data layouts, and communication. This separation simplifies targeting multiple hardware architectures with the same algorithm. We evaluate Tiramisu by writing a set of image processing, deep learning, and linear algebra benchmarks and compare them with state-of-the-art compilers and hand-tuned libraries. We show that Tiramisu matches or outperforms existing compilers and libraries on different hardware architectures, including multicore CPUs, GPUs, and distributed machines.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 11; 2023: 6; 2024: 10; 2025: 9; 2026: 7.
53 papers.
Sort:
By area:
- 2023Full Stack Optimization of Transformer Inference: a Surveycited by 79
- 2021DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusioncited by 56
- 2021FLAT: An Optimized Dataflow for Mitigating Attention Bottleneckscited by 38
- 2022TensorIR: An Abstraction for Automatic Tensorized Program Optimizationcited by 38
- 2021A Deep Learning Based Cost Model for Automatic Code Optimizationcited by 33
- 2022Tensor Program Optimization with Probabilistic Programscited by 30
- 2022Hidet: Task-Mapping Programming Paradigm for Deep Learning Tensor Programscited by 28
- 2021Mind Mappings: Enabling Efficient Algorithm-Accelerator Mapping Space Searchcited by 24
- 2021CoSA: Scheduling by Constrained Optimization for Spatial Acceleratorscited by 22
- 2021The CoRa Tensor Compiler: Compilation for Ragged Tensors with Minimal Paddingcited by 17
- 2024Allo: A Programming Model for Composable Accelerator Designcited by 16
- 2022TLP: A Deep Learning-based Cost Model for Tensor Program Tuningcited by 14
38 more
- 2023Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Trainingcited by 11
- 2022Decompiling x86 Deep Neural Network Executablescited by 7
- 2024LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilerscited by 7
- 2024FlashRNN: I/O-Aware Optimization of Traditional RNNs on modern hardwarecited by 7
- 2021A Reinforcement Learning Environment for Polyhedral Optimizationscited by 5
- 2021Bring Your Own Codegen to Deep Learning Compilercited by 5
- 2022Transfer-Tuning: Reusing Auto-Schedules for Efficient Tensor Program Code Generationcited by 5
- 2024SPLAT: A framework for optimised GPU code-generation for SParse reguLar ATtentioncited by 5
- 2021A Highly Configurable Hardware/Software Stack for DNN Inference Accelerationcited by 4
- 2025Agentic Auto-Scheduling: An Experimental Study of LLM-Guided Loop Optimizationcited by 4
- 2024A Reinforcement Learning Environment for Automatic Code Optimization in the MLIR Compilercited by 3
- 2025PyGraph: Robust Compiler Support for CUDA Graphs in PyTorchcited by 3
- 2025REASONING COMPILER: LLM-Guided Optimizations for Efficient Model Servingcited by 3
- 2021Collage: Seamless Integration of Deep Learning Backends with Automatic Placementcited by 2
- 2022Demystifying Map Space Exploration for NPUscited by 2
- 2024Pruner: A Draft-then-Verify Exploration Mechanism to Accelerate Tensor Program Tuningcited by 2
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimizationcited by 2
- 2022OLLIE: Derivation-based Tensor Program Optimizercited by 1
- 2023RAF: Holistic Compilation for Deep Learning Model Trainingcited by 1
- 2024Scorch: A Library for Sparse Deep Learningcited by 1
- 2024Combining Neural Architecture Search and Automatic Code Optimization: A Surveycited by 1
- 2025Tempo: Compiled Dynamic Deep Learning with Symbolic Dependence Graphscited by 1
- 2025LOOPerSet: A Large-Scale Dataset for Data-Driven Polyhedral Compiler Optimizationcited by 1
- 2026CHEHAB RL: Learning to Optimize Fully Homomorphic Encryption Computationscited by 1
- 2022FamilySeer: Towards Optimized Tensor Codes by Exploiting Computation Subgraph Similaritycited by 0
- 2022ALT: Boosting Deep Learning Performance by Breaking the Wall between Graph and Operator Level Optimizationscited by 0
- 2022AGO: Boosting Mobile AI Inference Performance by Removing Constraints on Graph Optimizationcited by 0
- 2023Performance Embeddings: A Similarity-based Approach to Automatic Performance Optimizationcited by 0
- 2023Grassroots Operator Search for Model Edge Adaptationcited by 0
- 2023mlirSynth: Automatic, Retargetable Program Raising in Multi-Level IR using Program Synthesiscited by 0
- 2024Compressing Structured Tensor Algebracited by 0
- 2024MAS-Attention: Memory-Aware Stream Processing for Attention Acceleration on Resource-Constrained Edge Devicescited by 0
- 2025Data-efficient Performance Modeling via Pre-trainingcited by 0
- 2025Designing across domains with declarative thinking: Insights from the 96-Eyes ptychographic imager projectcited by 0
- 2025PerfDojo: Automated ML Library Generation for Heterogeneous Architecturescited by 0
- 2025Morphling: Fast, Fused, and Flexible GNN Training at Scalecited by 0
- 2026Compiler-Assisted Speculative Sampling for Accelerated LLM Inference on Heterogeneous Edge Devicescited by 0
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learningcited by 0
50 most cited of 53 All 53 (JSON)
- 2026Effect of Abstractions and Prompting Strategies on LLM-Guided High-Performance Optimizations8 Aug 2026
- 2026Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation26 May 2026
- 2026Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels16 Apr 2026
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning14 Apr 2026
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimization24 Mar 2026
- 2026Compiler-Assisted Speculative Sampling for Accelerated LLM Inference on Heterogeneous Edge Devices8 Feb 2026
- 2026CHEHAB RL: Learning to Optimize Fully Homomorphic Encryption Computations27 Jan 2026
- 2025Morphling: Fast, Fused, and Flexible GNN Training at Scale1 Dec 2025
- 2025PerfDojo: Automated ML Library Generation for Heterogeneous Architectures5 Nov 2025
- 2025Agentic Auto-Scheduling: An Experimental Study of LLM-Guided Loop Optimization1 Nov 2025
- 2025LOOPerSet: A Large-Scale Dataset for Data-Driven Polyhedral Compiler Optimization11 Oct 2025
- 2025Designing across domains with declarative thinking: Insights from the 96-Eyes ptychographic imager project25 Aug 2025
38 more
- 2025REASONING COMPILER: LLM-Guided Optimizations for Efficient Model Serving2 Jun 2025
- 2025PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch25 Mar 2025
- 2025Data-efficient Performance Modeling via Pre-training24 Jan 2025
- 2025Tempo: Compiled Dynamic Deep Learning with Symbolic Dependence Graphs9 Jan 2025
- 2024FlashRNN: I/O-Aware Optimization of Traditional RNNs on modern hardware10 Dec 2024
- 2024MAS-Attention: Memory-Aware Stream Processing for Attention Acceleration on Resource-Constrained Edge Devices20 Nov 2024
- 2024A Reinforcement Learning Environment for Automatic Code Optimization in the MLIR Compiler17 Sep 2024
- 2024Combining Neural Architecture Search and Automatic Code Optimization: A Survey7 Aug 2024
- 2024SPLAT: A framework for optimised GPU code-generation for SParse reguLar ATtention23 Jul 2024
- 2024Compressing Structured Tensor Algebra18 Jul 2024
- 2024Scorch: A Library for Sparse Deep Learning27 May 2024
- 2024Allo: A Programming Model for Composable Accelerator Design7 Apr 2024
- 2024LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers18 Mar 2024
- 2024Pruner: A Draft-then-Verify Exploration Mechanism to Accelerate Tensor Program Tuning4 Feb 2024
- 2023mlirSynth: Automatic, Retargetable Program Raising in Multi-Level IR using Program Synthesis6 Oct 2023
- 2023Grassroots Operator Search for Model Edge Adaptation20 Sep 2023
- 2023Performance Embeddings: A Similarity-based Approach to Automatic Performance Optimization14 Mar 2023
- 2023RAF: Holistic Compilation for Deep Learning Model Training8 Mar 2023
- 2023Full Stack Optimization of Transformer Inference: a Survey27 Feb 2023
- 2023Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training16 Feb 2023
- 2022AGO: Boosting Mobile AI Inference Performance by Removing Constraints on Graph Optimization2 Dec 2022
- 2022TLP: A Deep Learning-based Cost Model for Tensor Program Tuning7 Nov 2022
- 2022ALT: Boosting Deep Learning Performance by Breaking the Wall between Graph and Operator Level Optimizations22 Oct 2022
- 2022Hidet: Task-Mapping Programming Paradigm for Deep Learning Tensor Programs18 Oct 2022
- 2022Demystifying Map Space Exploration for NPUs7 Oct 2022
- 2022Decompiling x86 Deep Neural Network Executables3 Oct 2022
- 2022OLLIE: Derivation-based Tensor Program Optimizer2 Aug 2022
- 2022TensorIR: An Abstraction for Automatic Tensorized Program Optimization9 Jul 2022
- 2022Tensor Program Optimization with Probabilistic Programs26 May 2022
- 2022Transfer-Tuning: Reusing Auto-Schedules for Efficient Tensor Program Code Generation14 Jan 2022
- 2022FamilySeer: Towards Optimized Tensor Codes by Exploiting Computation Subgraph Similarity1 Jan 2022
- 2021A Highly Configurable Hardware/Software Stack for DNN Inference Acceleration29 Nov 2021
- 2021Collage: Seamless Integration of Deep Learning Backends with Automatic Placement1 Nov 2021
- 2021The CoRa Tensor Compiler: Compilation for Ragged Tensors with Minimal Padding19 Oct 2021
- 2021DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusion30 Aug 2021
- 2021FLAT: An Optimized Dataflow for Mitigating Attention Bottlenecks13 Jul 2021
- 2021CoSA: Scheduling by Constrained Optimization for Spatial Accelerators5 May 2021
- 2021Bring Your Own Codegen to Deep Learning Compiler3 May 2021
50 newest of 53 All 53 (JSON)
- 2023Full Stack Optimization of Transformer Inference: a Surveycited by 79
- 2021DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusioncited by 56
- 2021FLAT: An Optimized Dataflow for Mitigating Attention Bottleneckscited by 38
- 2022TensorIR: An Abstraction for Automatic Tensorized Program Optimizationcited by 38
- 2021A Deep Learning Based Cost Model for Automatic Code Optimizationcited by 33
- 2022Tensor Program Optimization with Probabilistic Programscited by 30
- 2022Hidet: Task-Mapping Programming Paradigm for Deep Learning Tensor Programscited by 28
- 2021Mind Mappings: Enabling Efficient Algorithm-Accelerator Mapping Space Searchcited by 24
- 2021CoSA: Scheduling by Constrained Optimization for Spatial Acceleratorscited by 22
- 2021The CoRa Tensor Compiler: Compilation for Ragged Tensors with Minimal Paddingcited by 17
- 2024Allo: A Programming Model for Composable Accelerator Designcited by 16
- 2022TLP: A Deep Learning-based Cost Model for Tensor Program Tuningcited by 14
12 most cited of 48 All 48 (JSON)
- 2026Effect of Abstractions and Prompting Strategies on LLM-Guided High-Performance Optimizations8 Aug 2026
- 2026Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels16 Apr 2026
- 2026TCL: Enabling Fast and Efficient Cross-Hardware Tensor Program Optimization via Continual Learning14 Apr 2026
- 2026AscendOptimizer: Episodic Agent for Ascend NPU Operator Optimization24 Mar 2026
- 2026CHEHAB RL: Learning to Optimize Fully Homomorphic Encryption Computations27 Jan 2026
- 2025Morphling: Fast, Fused, and Flexible GNN Training at Scale1 Dec 2025
- 2025PerfDojo: Automated ML Library Generation for Heterogeneous Architectures5 Nov 2025
- 2025LOOPerSet: A Large-Scale Dataset for Data-Driven Polyhedral Compiler Optimization11 Oct 2025
- 2025Designing across domains with declarative thinking: Insights from the 96-Eyes ptychographic imager project25 Aug 2025
- 2025PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch25 Mar 2025
- 2025Data-efficient Performance Modeling via Pre-training24 Jan 2025
- 2025Tempo: Compiled Dynamic Deep Learning with Symbolic Dependence Graphs9 Jan 2025
12 newest of 48 All 48 (JSON)