mlsanityData to 14 Oct 2026

Forge-UGC: FX optimization and register-graph engine for universal graph compiler

arXiv 2604.16498 ↗First posted 14 Apr 2026cs.AR cs.AI cs.DCcited by 0

Not on the map. Why?

Abstract (arXiv)

We present Forge-UGC (FX Optimization and Register-Graph Engine for Universal Graph Compilation), a four-phase compiler for transformer deployment on heterogeneous accelerator hardware, validated on Intel AI Boost NPU. Existing frameworks such as OpenVINO and ONNX Runtime often use opaque compilation pipelines, limited pass-level visibility, and weak buffer management, which can lead to higher compilation cost and runtime overhead. Forge-UGC addresses this with a hardware-agnostic design that separates graph capture, optimization, intermediate representation lowering, and backend scheduling. Phase 1 captures graphs with torch.export at the ATen operator level, supporting modern transformer components such as rotary position embeddings, grouped-query attention, and SwiGLU without manual decomposition. Phase 2 applies six optimization passes: dead code elimination, common subexpression elimination, constant folding, attention fusion, operator fusion, and layout optimization, reducing graph node count by 14.2 to 21.9%. Phase 3 lowers the optimized graph into a typed intermediate representation with explicit virtual register assignments. Phase 4 performs liveness analysis, linear-scan buffer allocation, reducing peak buffer count by 30 to 48%, and device-affinity scheduling, reducing NPU-CPU transitions by 42 to 65%. Across six model families ranging from 125M to 8B parameters, evaluated on WikiText-103 and GLUE, Forge-UGC delivers 6.9 to 9.2x faster compilation than OpenVINO and ONNX Runtime, 18.2 to 35.7% lower inference latency, and 30.2 to 40.9% lower energy per inference. Fidelity is preserved, with max absolute logit differences below 2.1e-5 and KL divergence below 8.4e-9. We also introduce Fusion Gain Ratio, Compilation Efficiency Index, and per-pass execution profiling for systematic evaluation of NPU compilation pipelines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 26 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

9 of 26 references.

References · 9

  1. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  3. 2016Pointer Sentinel Mixture Modelscited by 3,096
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  5. 2018Glow: Graph Lowering Compiler Techniques for Neural Networkscited by 75
  6. 2021DNNFusion: Accelerating Deep Neural Networks Execution with Advanced Operator Fusioncited by 57
  7. 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 40
  8. 2020A Tensor Compiler for Unified Machine Learning Prediction Servingcited by 20
  9. 2026Hexagon-MLIR: An AI Compilation Stack For Qualcomm's Neural Processing Units (NPUs)cited by 2

Built on by

Not cited yet.