SimCLF: A Simple Contrastive Learning Framework for Function-level Binary Embeddings
Not on the map. Why?
Abstract (arXiv)
Function-level binary code similarity detection is a crucial aspect of cybersecurity. It enables the detection of bugs and patent infringements in released software and plays a pivotal role in preventing supply chain attacks. A practical embedding learning framework relies on the robustness of the assembly code representation and the accuracy of function-pair annotation, which is traditionally accomplished using supervised learning-based frameworks. However, annotating different function pairs with accurate labels poses considerable challenges. These supervised learning methods can be easily overtrained and suffer from representation robustness problems. To address these challenges, we propose SimCLF: A Simple Contrastive Learning Framework for Function-level Binary Embeddings. We take an unsupervised learning approach and formulate binary code similarity detection as instance discrimination. SimCLF directly operates on disassembled binary functions and could be implemented with any encoder. It does not require manually annotated information but only augmented data. Augmented data is generated using compiler optimization options and code obfuscation techniques. The experimental results demonstrate that SimCLF surpasses the state-of-the-art in accuracy and has a significant advantage in few-shot settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 47 references that are in the map. First posted on arXiv 6 Sep 2022.
Builds on
25 of 47 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,838
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
13 more
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2020Understanding the Behaviour of Contrastive Losscited by 397
- 2019Representation Degeneration Problem in Training Natural Language Generation Modelscited by 250
- 2021ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfercited by 231
- 2021Towards the Generalization of Contrastive Self-Supervised Learningcited by 99
- 2020Dos and Don'ts of Machine Learning in Computer Securitycited by 98
- 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
- 2018SAFE: Self-Attentive Function Embeddings for Binary Similaritycited by 33
- 2019A Survey of Binary Code Similaritycited by 18
- 2021Semantic-aware Binary Code Representation with BERTcited by 6
Built on by
Not cited yet.