mlsanityData to 7 Oct 2026

UniASM: Binary Code Similarity Detection without Fine-tuning

arXiv 2211.01144 ↗First posted 28 Oct 2022cs.CR cs.LG cs.SEcited by 3

Not on the map. Why?

Abstract (arXiv)

Binary code similarity detection (BCSD) is widely used in various binary analysis tasks such as vulnerability search, malware detection, clone detection, and patch analysis. Recent studies have shown that the learning-based binary code embedding models perform better than the traditional feature-based approaches. However, previous studies have not delved deeply into the key factors that affect model performance. In this paper, we design extensive ablation studies to explore these influencing factors. The experimental results have provided us with many new insights. We have made innovations in both code representation and model selection: we propose a novel rich-semantic function representation technique to ensure the model captures the intricate nuances of binary code, and we introduce the first UniLM-based binary code embedding model, named UniASM, which includes two newly designed training tasks to learn representations of binary functions. The experimental results show that UniASM outperforms the state-of-the-art (SOTA) approaches on the evaluation datasets. The average scores of Recall@1 on cross-compilers, cross-optimization-levels, and cross-obfuscations have improved by 12.7%, 8.5%, and 22.3%, respectively, compared to the best of the baseline methods. Besides, in the real-world task of known vulnerability search, UniASM outperforms all the current baselines.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 84 references that are in the map. First posted on arXiv 28 Oct 2022.

Builds on

24 of 84 references.

References · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  4. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  7. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  8. 2014Distributed Representations of Sentences and Documentscited by 677
  9. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  10. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  11. 2019Graph Matching Networks for Learning the Similarity of Graph Structured Objectscited by 202
  12. 2021Condenser: a Pre-training Architecture for Dense Retrievalcited by 162
12 more
  1. 2021GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrievalcited by 119
  2. 2021Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoderscited by 88
  3. 2017Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detectioncited by 65
  4. 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
  5. 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
  6. 2018SAFE: Self-Attentive Function Embeddings for Binary Similaritycited by 33
  7. 2018Neural Machine Translation Inspired Binary Code Similarity Comparison beyond Function Pairscited by 25
  8. 2020Revisiting Binary Code Similarity Analysis using Interpretable Feature Engineering and Lessons Learnedcited by 14
  9. 2020Bin2vec: Learning Representations of Binary Executable Programs for Security Taskscited by 8
  10. 2021Asteria: Deep Learning-based AST-Encoding for Cross-platform Binary Code Similarity Detectioncited by 8
  11. 2021Semantic-aware Binary Code Representation with BERTcited by 6
  12. 2019A Semantics-Based Hybrid Approach on Binary Code Similarity Comparisoncited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.