mlsanityData to 7 Oct 2026

ShieldedCode: Learning Robust Representations for Virtual Machine Protected Code

arXiv 2601.20679 ↗First posted 28 Jan 2026cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have achieved remarkable progress in code generation, yet their potential for software protection remains largely untapped. Reverse engineering continues to threaten software security, while traditional virtual machine protection (VMP) relies on rigid, rule-based transformations that are costly to design and vulnerable to automated analysis. In this work, we present the first protection-aware framework that learns robust representations of VMP-protected code. Our approach builds large-scale paired datasets of source code and normalized VM implementations, and introduces hierarchical dependency modeling at intra-, preceding-, and inter-instruction levels. We jointly optimize language modeling with functionality-aware and protection-aware contrastive objectives to capture both semantic equivalence and protection strength. To further assess resilience, we propose a protection effectiveness optimization task that quantifies and ranks different VM variants derived from the same source. Coupled with a two-stage continual pre-training and fine-tuning pipeline, our method enables models to generate, compare, and reason over protected code. Extensive experiments show that our framework significantly improves robustness across diverse protection levels, opening a new research direction for learning-based software defense. In this work, we present ShieldedCode, the first protection-aware framework that learns robust representations of VMP-protected code. Our method achieves 26.95% Pass@1 on L0 VM code generation compared to 22.58% for GPT-4o., and improves binary similarity detection Recall@1 by 10% over state of art methods like jTrans.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 28 Jan 2026.

Builds on

30 of 48 references.

References · 30

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  4. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  5. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  6. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  7. 2022The Stack: 3 TB of permissively licensed source codecited by 354
  8. 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
  9. 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 116
  10. 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completioncited by 110
  11. 2023Improving Code Generation by Training with Natural Language Feedbackcited by 75
  12. 2017Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detectioncited by 65
18 more
  1. 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
  2. 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
  3. 2024Meta Large Language Model Compiler: Foundation Models of Compiler Optimizationcited by 39
  4. 2020Trex: Learning Execution Semantics from Micro-Traces for Binary Similaritycited by 34
  5. 2021CAST: Enhancing Code Summarization with Hierarchical Splitting and Reconstruction of Abstract Syntax Treescited by 31
  6. 2024CLAP: Learning Transferable Binary Code Representations with Natural Language Supervisioncited by 17
  7. 2025MedConv: Convolutions Beat Transformers on Long-Tailed Bone Density Predictioncited by 16
  8. 2022Beyond the C: Retargetable Decompilation using Neural Machine Translationcited by 15
  9. 2025PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inferencecited by 14
  10. 2025Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Modelscited by 14
  11. 2023Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learningcited by 12
  12. 2025MediAug: Exploring Visual Augmentation in Medical Imagingcited by 12
  13. 2025CAD-VAE: Leveraging Correlation-Aware Latents for Comprehensive Fair Disentanglementcited by 10
  14. 2022HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representationscited by 9
  15. 2024LLM-Powered Grapheme-to-Phoneme Conversion: Benchmark and Case Studycited by 9
  16. 2025PathoHR: Breast Cancer Survival Prediction on High-Resolution Pathological Imagescited by 9
  17. 2025HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performancecited by 9
  18. 2024CEBin: A Cost-Effective Framework for Large-Scale Binary Code Similarity Detectioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.