LLM Translation of Compiler Intermediate Representation
Not on the map. Why?
Abstract (arXiv)
GCC and LLVM underpin much of modern software infrastructure, relying on distinct Intermediate Representations (IRs) to drive optimizations and code generation. However, the semantic and structural differences between these IRs create significant barriers for cross-toolchain interaction, limiting the reuse of compiler frontends, backends, and optimization pipelines across programming languages and compilation ecosystems. Traditional rule-based translators have attempted to bridge this gap, but their complexity and maintenance cost have hindered practical adoption. In this context, Large Language Models (LLMs) appear to be an emerging technology that offers a data-driven alternative, capable of learning complex mappings between heterogeneous compiler IRs directly from sufficiently representative examples. To explore this approach, this paper presents IRIS-14B, a 14-billion-parameter transformer model fine-tuned to translate GIMPLE (as emitted by GCC) to LLVM IR (as emitted by LLVM). The model is trained on paired IRs extracted from C sources and evaluated on the GIMPLE-to-LLVM IR transformation applied to IRs derived from real-world C code and competitive programming problems. To the best of our knowledge, IRIS-14B is the first model trained explicitly for IR-to-IR translation. It outperforms the accuracy of widely used models, including the largest state-of-the-art open models available today, ranging from 13 to 1,000 billion parameters, by up to 44 percentage points. The proposed transformation supports the integration of LLMs as complementary components within hybrid neuro-symbolic compiler architectures, where models such as IRIS-14B act as interoperability layers enabling cross-toolchain workflows without modifying existing compiler passes, while traditional compiler infrastructure continues to perform deterministic compilation and optimization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
12 of 36 references.
References · 12
- 2017Attention Is All You Needcited by 60,361
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2022The Stack: 3 TB of permissively licensed source codecited by 359
- 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
- 2023Large Language Models for Compiler Optimizationcited by 52
- 2024Towards Translating Real-World Code with LLMs: A Study of Translating to Rustcited by 35
- 2024IRCoder: Intermediate Representations Make Language Models Robust Multilingual Code Generatorscited by 23
- 2023ComPile: A Large IR Dataset from Production Sourcescited by 10
- 2025Do Code LLMs Understand Design Patterns?cited by 9
- 2025LLM-Assisted Translation of Legacy FORTRAN Codes to C++: A Cross-Platform Studycited by 7
Built on by
Not cited yet.