Callee: Recovering Call Graphs for Binaries with Transfer and Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Recovering binary programs' call graphs is crucial for inter-procedural analysis tasks and applications based on them.transfer One of the core challenges is recognizing targets of indirect calls (i.e., indirect callees). Existing solutions all have high false positives and negatives, making call graphs inaccurate. In this paper, we propose a new solution Callee combining transfer learning and contrastive learning. The key insight is that, deep neural networks (DNNs) can automatically identify patterns concerning indirect calls, which can be more efficient than designing approximation algorithms or heuristic rules to handle various cases. Inspired by the advances in question-answering applications, we utilize contrastive learning to answer the callsite-callee question. However, one of the toughest challenges is that DNNs need large datasets to achieve high performance, while collecting large-scale indirect-call ground-truths can be computational-expensive. Since direct calls and indirect calls share similar calling conventions, it is possible to transfer knowledge learned from direct calls to indirect ones. Therefore, we leverage transfer learning to pre-train DNNs with easy-to-collect direct calls and further fine-tune the indirect-call DNNs. We evaluate Callee on several groups of targets, and results show that our solution could match callsites to callees with an F1-Measure of 94.6%, much better than state-of-the-art solutions. Further, we apply Callee to binary code similarity detection and hybrid fuzzing, and found it could greatly improve their performance.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 21 of its 90 references that are in the map. First posted on arXiv 2 Nov 2021.
Builds on
21 of 90 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2014Distributed Representations of Sentences and Documentscited by 677
- 2017Interpretation of Neural Networks is Fragilecited by 443
- 2017Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detectioncited by 65
- 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
9 more
- 2017Improved Neural Relation Detection for Knowledge Base Question Answeringcited by 44
- 2018Neural Machine Translation Inspired Binary Code Similarity Comparison beyond Function Pairscited by 25
- 2020XDA: Accurate, Robust Disassembly with Transfer Learningcited by 21
- 2014Deep Learning for Answer Sentence Selectioncited by 17
- 2020Revisiting Binary Code Similarity Analysis using Interpretable Feature Engineering and Lessons Learnedcited by 14
- 2019Simple Question Answering with Subgraph Ranking and Joint-Scoringcited by 8
- 2017Automatic Question-Answering Using A Deep Similarity Neural Networkcited by 3
- 2020TeeRex: Discovery and Exploitation of Memory Corruption Vulnerabilities in SGX Enclavescited by 2
- 2021Cross-Lingual Transfer Learning for Statistical Type Inferencecited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.
4 papers.
- 2023kTrans: Knowledge-Aware Transformer for Binary Code Embeddingcited by 10
- 2024MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarizationcited by 5
- 2024A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfercited by 1
- 2026Agentic Vulnerability Reasoning on COTS Binariescited by 0
- 2026Agentic Vulnerability Reasoning on COTS Binaries6 May 2026
- 2024A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer15 Dec 2024
- 2024MALSIGHT: Exploring Malicious Source Code and Benign Pseudocode for Iterative Binary Malware Summarization26 Jun 2024
- 2023kTrans: Knowledge-Aware Transformer for Binary Code Embedding24 Aug 2023