mlsanityData to 7 Oct 2026

BLens: Contrastive Captioning of Binary Functions using Ensemble Embedding

arXiv 2409.07889 ↗First posted 12 Sep 2024cs.LG cs.CRcited by 3

Not on the map. Why?

Abstract (arXiv)

Function names can greatly aid human reverse engineers, which has spurred the development of machine learning-based approaches to predicting function names in stripped binaries. Much current work in this area now uses transformers, applying a metaphor of machine translation from code to function names. Still, function naming models face challenges in generalizing to projects unrelated to the training set. In this paper, we take a completely new approach by transferring advances in automated image captioning to the domain of binary reverse engineering, such that different parts of a binary function can be associated with parts of its name. We propose BLens, which combines multiple binary function embeddings into a new ensemble representation, aligns it with the name representation latent space via a contrastive learning approach, and generates function names with a transformer architecture tailored for function names. Our experiments demonstrate that BLens significantly outperforms the state of the art. In the usual setting of splitting per binary, we achieve an F1 score of 0.79 compared to 0.70. In the cross-project setting, which emphasizes generalizability, we achieve an F1 score of 0.46 compared to 0.29. Finally, in an experimental setting reducing shared components across projects, we achieve an F1 score of 0.32 compared to 0.19.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 56 of its 102 references that are in the map. First posted on arXiv 12 Sep 2024.

Builds on

56 of 102 references.

References · 56

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2016Layer Normalizationcited by 5,579
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  9. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  10. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  11. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  12. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
38 more
  1. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
  2. 2021Florence: A New Foundation Model for Computer Visioncited by 802
  3. 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
  4. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
  5. 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
  6. 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
  7. 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
  8. 2022Mitigating Neural Network Overconfidence with Logit Normalizationcited by 251
  9. 2018code2vec: Learning Distributed Representations of Codecited by 249
  10. 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
  11. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 221
  12. 2019Graph Matching Networks for Learning the Similarity of Graph Structured Objectscited by 202
  13. 2021Scaling Up Vision-Language Pre-training for Image Captioningcited by 196
  14. 2024The pitfalls of next-token predictioncited by 156
  15. 2023X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languagescited by 127
  16. 2019Insertion Transformer: Flexible Sequence Generation via Insertion Operationscited by 123
  17. 2023Accelerating Transformer Inference for Translation via Parallel Decodingcited by 123
  18. 2022Should You Mask 15% in Masked Language Modeling?cited by 117
  19. 2020Contrastive Code Representation Learningcited by 76
  20. 2017Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detectioncited by 65
  21. 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
  22. 2023PaSS: Parallel Speculative Samplingcited by 49
  23. 2020Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Textcited by 46
  24. 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
  25. 2019Insertion-based Decoding with automatically Inferred Generation Ordercited by 43
  26. 2019DIRE: A Neural Approach to Decompiled Identifier Namingcited by 36
  27. 2020Trex: Learning Execution Semantics from Micro-Traces for Binary Similaritycited by 34
  28. 2018SAFE: Self-Attentive Function Embeddings for Binary Similaritycited by 33
  29. 2019Reflective Decoding Network for Image Captioningcited by 31
  30. 2020Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Ordercited by 28
  31. 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
  32. 2021How could Neural Networks understand Programs?cited by 26
  33. 2021Augmenting Decompiler Output with Learned Variable Names and Typescited by 23
  34. 2019An Observational Investigation of Reverse Engineers' Processescited by 20
  35. 2021Towards Learning (Dis)-Similarity of Source Code from Program Contrastscited by 17
  36. 2024CLAP: Learning Transferable Binary Code Representations with Natural Language Supervisioncited by 17
  37. 2021Discovering Non-monotonic Autoregressive Orderings with Variational Inferencecited by 15
  38. 2023Mitigating Transformer Overconfidence via Lipschitz Regularizationcited by 15

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.