Cross-modal Retrieval Models for Stripped Binary Analysis
Not on the map. Why?
Abstract (arXiv)
Retrieving binary code via natural language queries is a pivotal capability for downstream tasks in the software security domain, such as vulnerability detection and malware analysis. However, it is challenging to identify binary functions semantically relevant to the user query from thousands of candidates, as the absence of symbolic information distinguishes this task from source code retrieval. In this paper, we introduce, BinSeek, a two-stage cross-modal retrieval framework for stripped binary code analysis. It consists of two models: BinSeek-Embedding is trained on large-scale dataset to learn the semantic relevance of the binary code and the natural language description, furthermore, BinSeek-Reranker learns to carefully judge the relevance of the candidate code to the description with context augmentation. To this end, we built an LLM-based data synthesis pipeline to automate training construction, also deriving a domain benchmark for future research. Our evaluation results show that BinSeek achieved the state-of-the-art performance, surpassing the the same scale models by 31.42% in Rec@3 and 27.17% in MRR@3, as well as leading the advanced general-purpose models that have 16 times larger parameters.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 47 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
29 of 47 references.
References · 29
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 744
- 2016Language Modeling with Gated Convolutional Networkscited by 702
17 more
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
- 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 361
- 2025EmbeddingGemma: Powerful and Lightweight Text Representationscited by 139
- 2019Neural Machine Translation with Byte-Level Subwordscited by 115
- 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 91
- 2025jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrievalcited by 76
- 2024KAG: Boosting LLMs in Professional Domains via Knowledge Augmented Generationcited by 67
- 2024CoIR: A Comprehensive Benchmark for Code Information Retrieval Modelscited by 60
- 2022jTrans: Jump-Aware Transformer for Binary Code Similaritycited by 44
- 2024CodeXEmbed: A Generalist Embedding Model Family for Multiligual and Multi-task Code Retrievalcited by 34
- 2023Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformerscited by 30
- 2025jina-reranker-v3: Last but Not Late Interaction for Listwise Document Rerankingcited by 24
- 2025CompileAgent: Automated Real-World Repo-Level Compilation with Tool-Integrated LLM-based Agent Systemcited by 15
- 2023GraphMoco:a Graph Momentum Contrast Model that Using Multimodel Structure Information for Large-scale Binary Function Representation Learningcited by 5
- 2025ReCopilot: Reverse Engineering Copilot in Binary Analysiscited by 5
- 2024FoC: Figure out the Cryptographic Functions in Stripped Binaries with LLMscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Beyond Embeddings: Interpretable Feature Extraction for Binary Code Similarity
- 2025ReVul-CoT: Towards Effective Software Vulnerability Assessment with Retrieval-Augmented Generation and Chain-of-Thought Prompting
- 2026Practical Source Code Recovery from Binary Functions Using Anchor-Based Retrieval and LLM Reasoning
- 2026Can LLMs Deobfuscate Binary Code? A Systematic Analysis of Large Language Models into Pseudocode Deobfuscation ↗
- 2024A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer
- 2024Source Code Foundation Models are Transferable Binary Analysis Knowledge Bases
- 2026SoK: AI-Augmented Binary Reversing
- 2025Binary BPE: A Family of Cross-Platform Tokenizers for Binary Analysis