mlsanityData to 7 Oct 2026

UniRTL: Unifying Code and Graph for Robust RTL Representation Learning

arXiv 2605.31040 ↗First posted 29 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Developing effective representations for register transfer level (RTL) designs is crucial for accelerating the hardware design workflow. Existing approaches, however, typically rely on a single data modality, either the RTL code or its associated graph-based representation, limiting the expressiveness and generalization ability of the learned representations. For RTL, the control data flow graph (CDFG) offers a comprehensive structural representation that preserves complete information, while the code modality explicitly encodes semantic and functional information. We argue that integrating these complementary modalities is essential for a thorough understanding of RTL designs. To this end, we propose UniRTL, a multimodal pretraining framework that learns unified RTL representations by jointly leveraging code and CDFG. UniRTL achieves fine-grained alignment between code and graph through mutual masked modeling and employs a hierarchical training strategy that incorporates a pretrained graph-aware tokenizer and staged alignment of text (i.e., functional summary) and code prior to graph integration. We evaluate UniRTL on two downstream tasks, performance prediction and code retrieval, under multiple settings. Experimental results show that UniRTL consistently outperforms prior methods, establishing it as a more robust and powerful foundation for advancing hardware design automation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

38 of 50 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2017Graph Attention Networkscited by 8,854
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2018How Powerful are Graph Neural Networks?cited by 4,355
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2023Qwen Technical Reportcited by 3,273
  11. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  12. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
26 more
  1. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  2. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
  3. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  4. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 702
  5. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
  6. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  7. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  8. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 466
  9. 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 424
  10. 2022Text and Code Embeddings by Contrastive Pre-Trainingcited by 358
  11. 2024Generative Representational Instruction Tuningcited by 227
  12. 2024VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Taskscited by 222
  13. 2024BetterV: Controlled Verilog Generation with Discriminative Guidancecited by 99
  14. 2022Unified Speech-Text Pre-training for Speech Translation and Recognitioncited by 64
  15. 2024OriGen:Enhancing RTL Code Generation with Code-to-Code Augmentation and Self-Reflectioncited by 56
  16. 2024MG-Verilog: Multi-grained Dataset Towards Enhanced LLM-assisted Verilog Generationcited by 45
  17. 2024CraftRTL: High-quality Synthetic Data Generation for Verilog Code Models with Correct-by-Construction Non-Textual Representations and Targeted Code Repaircited by 41
  18. 2024CodeV: Empowering LLMs with HDL Generation through Multi-Level Summarizationcited by 38
  19. 2025DeepRTL: Bridging Verilog Understanding and Generation with a Unified Representation Modelcited by 23
  20. 2025DeepCircuitX: A Comprehensive Repository-Level Dataset for RTL Code Understanding, Generation, and PPA Analysiscited by 21
  21. 2022Statistical Properties of the log-cosh Loss Function Used in Machine Learningcited by 15
  22. 2025CircuitFusion: Multimodal Circuit Representation Learning for Agile Chip Designcited by 14
  23. 2023Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignmentcited by 13
  24. 2025DeepRTL2: A Versatile Model for RTL-Related Taskscited by 10
  25. 2024The Graph's Apprentice: Teaching an LLM Low Level Knowledge for Circuit Quality Estimationcited by 3
  26. 2025Beyond Tokens: Enhancing RTL Quality Estimation via Structural Graph Learningcited by 1

Built on by

Not cited yet.