ShieldedCode: Learning Robust Representations for Virtual Machine Protected Code
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have achieved remarkable progress in code generation, yet their potential for software protection remains largely untapped. Reverse engineering continues to threaten software security, while traditional virtual machine protection (VMP) relies on rigid, rule-based transformations that are costly to design and vulnerable to automated analysis. In this work, we present the first protection-aware framework that learns robust representations of VMP-protected code. Our approach builds large-scale paired datasets of source code and normalized VM implementations, and introduces hierarchical dependency modeling at intra-, preceding-, and inter-instruction levels. We jointly optimize language modeling with functionality-aware and protection-aware contrastive objectives to capture both semantic equivalence and protection strength. To further assess resilience, we propose a protection effectiveness optimization task that quantifies and ranks different VM variants derived from the same source. Coupled with a two-stage continual pre-training and fine-tuning pipeline, our method enables models to generate, compare, and reason over protected code. Extensive experiments show that our framework significantly improves robustness across diverse protection levels, opening a new research direction for learning-based software defense. In this work, we present ShieldedCode, the first protection-aware framework that learns robust representations of VMP-protected code. Our method achieves 26.95% Pass@1 on L0 VM code generation compared to 22.58% for GPT-4o., and improves binary similarity detection Recall@1 by 10% over state of art methods like jTrans.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
30 of 48 references.
References · 30
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2022Competition-Level Code Generation with AlphaCodecited by 1,427
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2022The Stack: 3 TB of permissively licensed source codecited by 354
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 342
- 2024Granite Code Models: A Family of Open Foundation Models for Code Intelligencecited by 116
- 2023LongCoder: A Long-Range Pre-trained Language Model for Code Completioncited by 110
- 2023Improving Code Generation by Training with Natural Language Feedbackcited by 75
- 2017Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detectioncited by 65
18 more
- 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
- 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
- 2024Meta Large Language Model Compiler: Foundation Models of Compiler Optimizationcited by 39
- 2020Trex: Learning Execution Semantics from Micro-Traces for Binary Similaritycited by 34
- 2021CAST: Enhancing Code Summarization with Hierarchical Splitting and Reconstruction of Abstract Syntax Treescited by 31
- 2024CLAP: Learning Transferable Binary Code Representations with Natural Language Supervisioncited by 17
- 2025MedConv: Convolutions Beat Transformers on Long-Tailed Bone Density Predictioncited by 16
- 2022Beyond the C: Retargetable Decompilation using Neural Machine Translationcited by 15
- 2025PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inferencecited by 14
- 2025Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Modelscited by 14
- 2023Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learningcited by 12
- 2025MediAug: Exploring Visual Augmentation in Medical Imagingcited by 12
- 2025CAD-VAE: Leveraging Correlation-Aware Latents for Comprehensive Fair Disentanglementcited by 10
- 2022HierarchyNet: Learning to Summarize Source Code with Heterogeneous Representationscited by 9
- 2024LLM-Powered Grapheme-to-Phoneme Conversion: Benchmark and Case Studycited by 9
- 2025PathoHR: Breast Cancer Survival Prediction on High-Resolution Pathological Imagescited by 9
- 2025HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performancecited by 9
- 2024CEBin: A Cost-Effective Framework for Large-Scale Binary Code Similarity Detectioncited by 3
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026EGAD: Entropy-Guided Adaptive Distillation for Token-Level Knowledge Transfercited by 2
- 2026FinInvest-GTCN: Explainable Graph-Temporal-Causal Modeling for Risk-Aware Investment Decision Optimizationcited by 0
- 2026EVLA: An Electro-Aware Multimodal Assistant for Physically-Grounded Driving Reasoning and Controlcited by 0
- 2026A3M: Adaptive, Adversarial and Multi-Objective Learning for Strategic Bidding in Repeated Auctionscited by 0
- 2026Dependency-Guided Code Generation: Structured Matrix Decomposition and Consistency-Guided Refinementcited by 0
- 2026Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generationcited by 0
- 2026Code Consistency Preference Optimization Verification for Language Model Alignmentcited by 0
- 2026CompileRover: Revolutionizing Virtual Machine Compiler Optimization with a Tri-Role LLM-Driven Frameworkcited by 0
- 2026CompileRover: Revolutionizing Virtual Machine Compiler Optimization with a Tri-Role LLM-Driven Framework21 Jul 2026
- 2026Code Consistency Preference Optimization Verification for Language Model Alignment18 Jul 2026
- 2026Though Language Models Err While They Strive: Conformal Prediction for Self-Correcting Scientific Generation18 Jul 2026
- 2026Dependency-Guided Code Generation: Structured Matrix Decomposition and Consistency-Guided Refinement18 Jul 2026
- 2026A3M: Adaptive, Adversarial and Multi-Objective Learning for Strategic Bidding in Repeated Auctions27 Jun 2026
- 2026EVLA: An Electro-Aware Multimodal Assistant for Physically-Grounded Driving Reasoning and Control27 Jun 2026
- 2026FinInvest-GTCN: Explainable Graph-Temporal-Causal Modeling for Risk-Aware Investment Decision Optimization27 Jun 2026
- 2026EGAD: Entropy-Guided Adaptive Distillation for Token-Level Knowledge Transfer3 May 2026