mlsanityData to 14 Oct 2026

Instruction Alignment for Binary Code Representation Learning

arXiv 2608.11766 ↗First posted 12 Aug 2026cs.SE cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Binary code representation learning is a fundamental problem in software security and reverse engineering. Existing methods mainly learn function-level embeddings that capture coarse-grained semantic relationships between binary functions, but they largely ignore fine-grained instruction-level correspondences. This limitation misses valuable supervision signals available from compiler debug information, which can support the learning of more accurate and interpretable binary code representations. We propose to leverage instruction alignment knowledge to further improve binary code representation learning. Our preliminary study reveals that models finetuned for function-level binary code similarity exhibit substantially better instruction alignment than their pre-trained model, suggesting a strong correlation between instruction alignment and function-level embedding quality. Motivated by this observation, we design a training approach that explicitly incorporates instruction alignment as an auxiliary training objective. Our experiments show that instruction alignment training improves retrieval accuracy and provides more discriminative signal for the model's similarity judgments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 78 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

23 of 78 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
  4. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  5. 2014Distributed Representations of Sentences and Documentscited by 678
  6. 2020Contrastive Learning with Hard Negative Samplescited by 628
  7. 2018Neural Code Comprehension: A Learnable Representation of Code Semanticscited by 59
  8. 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
  9. 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
  10. 2018SAFE: Self-Attentive Function Embeddings for Binary Similaritycited by 33
  11. 2023Refining Decompiled C Code with Large Language Modelscited by 24
  12. 2019A Survey of Binary Code Similaritycited by 19
11 more
  1. 2024CLAP: Learning Transferable Binary Code Representations with Natural Language Supervisioncited by 17
  2. 2023Nova: Generative Language Models for Assembly Code with Hierarchical Attention and Contrastive Learningcited by 12
  3. 2022Unleashing the Power of Compiler Intermediate Representation to Enhance Neural Program Embeddingscited by 10
  4. 2024BinaryAI: Binary Software Composition Analysis via Intelligent Binary Source Code Matchingcited by 9
  5. 2021Notes on the H-measure of classifier performancecited by 7
  6. 2023PEM: Representing Binary Program Semantics for Similarity Analysis via a Probabilistic Execution Modelcited by 5
  7. 2024Cross-Inlining Binary Function Similarity Detectioncited by 4
  8. 20211-to-1 or 1-to-n? Investigating the effect of function inlining on binary similarity analysiscited by 3
  9. 2024CEBin: A Cost-Effective Framework for Large-Scale Binary Code Similarity Detectioncited by 3
  10. 2025KEENHash: Hashing Programs into Function-Aware Embeddings for Large-Scale Binary Code Similarity Analysiscited by 2
  11. 2024Preserving Privacy in Software Composition Analysis: A Study of Technical Solutions and Enhancementscited by 1

Built on by

Not cited yet.