mlsanityData to 7 Oct 2026

Focus on What Matters: Fisher-Guided Adaptive Multimodal Fusion for Vulnerability Detection

arXiv 2601.02438 ↗First posted 5 Jan 2026cs.SE cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Software vulnerability detection can be formulated as a binary classification problem that determines whether a given code snippet contains security defects. Existing multimodal methods typically fuse Natural Code Sequence (NCS) representations extracted by pretrained models with Code Property Graph (CPG) representations extracted by graph neural networks, under the implicit assumption that introducing an additional modality necessarily yields information gain. Through empirical analysis, we demonstrate the limitations of this assumption: pretrained models already encode substantial structural information implicitly, leading to strong overlap between the two modalities; moreover, graph encoders are generally less effective than pretrained language models in feature extraction. As a result, naive fusion not only struggles to obtain complementary signals but can also dilute effective discriminative cues due to noise propagation. To address these challenges, we propose a task-conditioned complementary fusion strategy that uses Fisher information to quantify task relevance, transforming cross-modal interaction from full-spectrum matching into selective fusion within a task-sensitive subspace. Our theoretical analysis shows that, under an isotropic perturbation assumption, this strategy significantly tightens the upper bound on the output error. Based on this insight, we design the TaCCS-DFA framework, which combines online low-rank Fisher subspace estimation with an adaptive gating mechanism to enable efficient task-oriented fusion. Experiments on the BigVul, Devign, and ReVeal benchmarks demonstrate that TaCCS-DFA delivers up to a 6.3-point gain in F1 score with only a 3.4% increase in inference latency, while maintaining low calibration error.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 80 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

35 of 80 references.

References · 35

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2017On Calibration of Modern Neural Networkscited by 4,860
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  5. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  6. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  7. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  8. 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 776
  9. 2021Merging Models with Fisher-Weighted Averagingcited by 613
  10. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  11. 2018Regularisation of Neural Networks by Enforcing Lipschitz Continuitycited by 311
  12. 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
23 more
  1. 2018Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networkscited by 193
  2. 2017Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulationcited by 182
  3. 2020Deep Learning based Vulnerability Detection: Are We There Yet?cited by 142
  4. 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
  5. 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
  6. 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 91
  7. 2018Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approachcited by 89
  8. 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
  9. 2024Multimodal Alignment and Fusion: A Surveycited by 73
  10. 2023Large Language Models for Test-Free Fault Localizationcited by 67
  11. 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
  12. 2023Prompt-Enhanced Software Vulnerability Detection Using ChatGPTcited by 51
  13. 2019Getafix: Learning to Fix Bugs Automaticallycited by 40
  14. 2019Multi-Modal Attention Network Learning for Semantic Source Code Retrievalcited by 40
  15. 2018The Impact of Class Rebalancing Techniques on the Performance and Interpretation of Defect Prediction Modelscited by 29
  16. 2018Fisher Information and Natural Gradient Learning of Random Deep Networkscited by 28
  17. 2021On the Optimality of the Oja's Algorithm for Online PCAcited by 11
  18. 2024Vul-LMGNNs: Fusing language models and online-distilled graph neural networks for code vulnerability detectioncited by 11
  19. 2023Code-centric Learning-based Just-In-Time Vulnerability Detectioncited by 8
  20. 2024Coca: Improving and Explaining Graph Neural Network-Based Vulnerability Detection Systemscited by 8
  21. 2021VulSPG: Vulnerability detection based on slice property graph representation learningcited by 7
  22. 2024Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repaircited by 4
  23. 2025Propagation-Based Vulnerability Impact Assessment for Software Supply Chainscited by 2

Built on by

Not cited yet.