mlsanityData to 14 Oct 2026

Beyond Embeddings: Interpretable Feature Extraction for Binary Code Similarity

arXiv 2509.23449 ↗First posted 27 Sep 2025cs.AI cs.CR cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

Binary code similarity detection is a core task in reverse engineering. It supports malware analysis and vulnerability discovery by identifying semantically similar code in different contexts. Modern methods have progressed from manually engineered features to vector representations. Hand-crafted statistics (e.g., operation ratios) are interpretable, but shallow and fail to generalize. Embedding-based methods overcome this by learning robust cross-setting representations, but these representations are opaque vectors that prevent rapid verification. They also face a scalability-accuracy trade-off, since high-dimensional nearest-neighbor search requires approximations that reduce precision. Current approaches thus force a compromise between interpretability, generalizability, and scalability. We bridge these gaps using a language model-based agent to conduct structured reasoning analysis of assembly code and generate features such as input/output types, side effects, notable constants, and algorithmic intent. Unlike hand-crafted features, they are richer and adaptive. Unlike embeddings, they are human-readable, maintainable, and directly searchable with inverted or relational indexes. Without any matching training, our method respectively achieves 42% and 62% for recall@1 in cross-architecture and cross-optimization tasks, comparable to embedding methods with training (39% and 34%). Combined with embeddings, it significantly outperforms the state-of-the-art, demonstrating that accuracy, scalability, and interpretability can coexist.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 52 references that are in the map. First posted on arXiv 27 Sep 2025.

Builds on

19 of 52 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2020Scaling Laws for Neural Language Modelscited by 6,586
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  6. 2014Distributed Representations of Sentences and Documentscited by 678
  7. 2017A Structured Self-attentive Sentence Embeddingcited by 318
  8. 2017Malware Detection by Eating a Whole EXEcited by 115
  9. 2021PalmTree: Learning an Assembly Language Model for Instruction Embeddingcited by 49
  10. 2023Large Language Models for Code Analysis: Do LLMs Really Do Their Job?cited by 45
  11. 2024LLM4Decompile: Decompiling Binary Code with Large Language Modelscited by 39
  12. 2018SAFE: Self-Attentive Function Embeddings for Binary Similaritycited by 33
7 more
  1. 2024CLAP: Learning Transferable Binary Code Representations with Natural Language Supervisioncited by 17
  2. 2024Fuzzing BusyBox: Leveraging LLM and Crash Reuse for Embedded Bug Unearthingcited by 15
  3. 2022Cross-Language Binary-Source Code Matching with Intermediate Representationscited by 13
  4. 2023On the Way to SBOMs: Investigating Design Issues and Solutions in Practicecited by 4
  5. 2025FuncVul: An Effective Function Level Vulnerability Detection Model using LLM and Code Chunkcited by 4
  6. 2023Binary Code Similarity Detectioncited by 3
  7. 2023VEXIR2Vec: An Architecture-Neutral Embedding Framework for Binary Similaritycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cross-modal Retrieval Models for Stripped Binary Analysis
  2. 2026AsmRAG: LLM-Driven Malware Detection by Retrieving Functionally Similar Assembly Code
  3. 2025ReCopilot: Reverse Engineering Copilot in Binary Analysis
  4. 2026ConceptCoder: Improve Code Reasoning via Concept Learning
  5. 2024A Progressive Transformer for Unifying Binary Code Embedding and Knowledge Transfer
  6. 2026ExecRetrieval: Measuring the Functional-Correctness Gap in Code-Embedding Retrieval
  7. 2026SoK: AI-Augmented Binary Reversing
  8. 2026CrackMeBench: Binary Reverse Engineering for Agents