BLens: Contrastive Captioning of Binary Functions using Ensemble Embedding
Not on the map. Why?
Abstract (arXiv)
Function names can greatly aid human reverse engineers, which has spurred the development of machine learning-based approaches to predicting function names in stripped binaries. Much current work in this area now uses transformers, applying a metaphor of machine translation from code to function names. Still, function naming models face challenges in generalizing to projects unrelated to the training set. In this paper, we take a completely new approach by transferring advances in automated image captioning to the domain of binary reverse engineering, such that different parts of a binary function can be associated with parts of its name. We propose BLens, which combines multiple binary function embeddings into a new ensemble representation, aligns it with the name representation latent space via a contrastive learning approach, and generates function names with a transformer architecture tailored for function names. Our experiments demonstrate that BLens significantly outperforms the state of the art. In the usual setting of splitting per binary, we achieve an F1 score of 0.79 compared to 0.70. In the cross-project setting, which emphasizes generalizability, we achieve an F1 score of 0.46 compared to 0.29. Finally, in an experimental setting reducing shared components across projects, we achieve an F1 score of 0.32 compared to 0.19.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 102 references that are in the map. First posted on arXiv 12 Sep 2024.
Builds on
56 of 102 references.
References · 56
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Layer Normalizationcited by 5,579
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
38 more
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2021Florence: A New Foundation Model for Computer Visioncited by 802
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
- 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
- 2018code2vec: Learning Distributed Representations of Codecited by 249
- 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
- 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 221
- 2019Graph Matching Networks for Learning the Similarity of Graph Structured Objectscited by 202
- 2021Scaling Up Vision-Language Pre-training for Image Captioningcited by 196
- 2024The pitfalls of next-token predictioncited by 156
- 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 127
- 2019Insertion Transformer: Flexible Sequence Generation via Insertion Operationscited by 123
- 2023Accelerating Transformer Inference for Translation via Parallel Decodingcited by 123
- 2022Should You Mask 15% in Masked Language Modeling?cited by 117
- 2020Contrastive Code Representation Learningcited by 76
- 2017Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detectioncited by 65
- 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
- 2023PaSS: Parallel Speculative Samplingcited by 49
- 2020Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Textcited by 46
- 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
- 2019Insertion-based Decoding with automatically Inferred Generation Ordercited by 43
- 2019DIRE: A Neural Approach to Decompiled Identifier Namingcited by 36
- 2020Trex: Learning Execution Semantics from Micro-Traces for Binary Similaritycited by 34
- 2018SAFE: Self-Attentive Function Embeddings for Binary Similaritycited by 33
- 2019Reflective Decoding Network for Image Captioningcited by 31
- 2020Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Ordercited by 28
- 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
- 2021How could Neural Networks understand Programs?cited by 26
- 2021Augmenting Decompiler Output with Learned Variable Names and Typescited by 23
- 2019An Observational Investigation of Reverse Engineers' Processescited by 20
- 2021Towards Learning (Dis)-Similarity of Source Code from Program Contrastscited by 17
- 2024CLAP: Learning Transferable Binary Code Representations with Natural Language Supervisioncited by 17
- 2021Discovering Non-monotonic Autoregressive Orderings with Variational Inferencecited by 15
- 2023Mitigating Transformer Overconfidence via Lipschitz Regularizationcited by 15
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.