AutoVecCoder: Teaching LLMs to Generate Explicitly Vectorized Code
Not on the map. Why?
Abstract (arXiv)
Vectorization via Single Instruction, Multiple Data (SIMD) architectures is a cornerstone of high-performance computing. To fully exploit hardware potential, developers often resort to explicit vectorization using intrinsics, as compiler-based auto-vectorization frequently yields suboptimal results due to conservative static analysis. While Large Language Models (LLMs) have demonstrated remarkable proficiency in general code generation, they struggle with explicit vectorization due to the scarcity of high-quality corpora and the strict semantic constraints of low-level hardware instructions. In this paper, we propose AutoVecCoder, a novel framework designed to empower LLMs with the capability of automated explicit vectorization. AutoVecCoder integrates two core components: VecPrompt, an automated data synthesis pipeline to inject domain-specific intrinsic knowledge; and VecRL, a reinforcement learning framework that aligns code generation with execution efficiency. AutoVecCoder-8B trained by this framework achieves state-of-the-art performance on the SSE and AVX subsets of SimdBench and, in some cases, generates implementations surpassing standard -O3 optimizations, effectively overcoming the inherent bottlenecks of traditional automated vectorization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
18 of 35 references.
References · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2020Learning to summarize from human feedbackcited by 2,588
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 225
- 2025TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operatorscited by 75
- 2024A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languagescited by 66
- 2024EffiBench: Benchmarking the Efficiency of Automatically Generated Codecited by 64
- 2025AutoTriton: Automatic Triton Programming with Reinforcement Learning in LLMscited by 40
- 2024ECCO: Can We Improve Model-Generated Code Efficiency Without Sacrificing Functional Correctness?cited by 27
6 more
- 2024LLM-Vectorizer: LLM-based Verified Loop Vectorizercited by 25
- 2025Afterburner: Reinforcement Learning Facilitates Self-Improving Code Efficiency Optimizationcited by 18
- 2025Towards Better Correctness and Efficiency in Code Generationcited by 9
- 2025VecTrans: Enhancing Compiler Auto-Vectorization through LLM-Assisted Code Transformationscited by 4
- 2025IntrinTrans: LLM-based Intrinsic Code Translator for RISC-V Vectorcited by 2
- 2025VecIntrinBench: Benchmarking Cross-Architecture Intrinsic Code Migration for RISC-V Vectorcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024AutoVCoder: A Systematic Framework for Automated Verilog Code Generation using LLMs
- 2026From Brute Force to Semantic Insight: Performance-Guided Data Transformation Design with LLMs
- 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generation
- 2025Agentic Auto-Scheduling: An Experimental Study of LLM-Guided Loop Optimization
- 2026Improving HPC Code Generation Capability of LLMs via Online Reinforcement Learning with Real-Machine Benchmark Rewards
- 2025Seed-Coder: Let the Code Model Curate Data for Itself
- 2026AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
- 2024DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning