Focus on What Matters: Fisher-Guided Adaptive Multimodal Fusion for Vulnerability Detection
Not on the map. Why?
Abstract (arXiv)
Software vulnerability detection can be formulated as a binary classification problem that determines whether a given code snippet contains security defects. Existing multimodal methods typically fuse Natural Code Sequence (NCS) representations extracted by pretrained models with Code Property Graph (CPG) representations extracted by graph neural networks, under the implicit assumption that introducing an additional modality necessarily yields information gain. Through empirical analysis, we demonstrate the limitations of this assumption: pretrained models already encode substantial structural information implicitly, leading to strong overlap between the two modalities; moreover, graph encoders are generally less effective than pretrained language models in feature extraction. As a result, naive fusion not only struggles to obtain complementary signals but can also dilute effective discriminative cues due to noise propagation. To address these challenges, we propose a task-conditioned complementary fusion strategy that uses Fisher information to quantify task relevance, transforming cross-modal interaction from full-spectrum matching into selective fusion within a task-sensitive subspace. Our theoretical analysis shows that, under an isotropic perturbation assumption, this strategy significantly tightens the upper bound on the output error. Based on this insight, we design the TaCCS-DFA framework, which combines online low-rank Fisher subspace estimation with an adaptive gating mechanism to enable efficient task-oriented fusion. Experiments on the BigVul, Devign, and ReVeal benchmarks demonstrate that TaCCS-DFA delivers up to a 6.3-point gain in F1 score with only a 3.4% increase in inference latency, while maintaining low calibration error.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 80 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
35 of 80 references.
References · 35
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 776
- 2021Merging Models with Fisher-Weighted Averagingcited by 613
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2018Regularisation of Neural Networks by Enforcing Lipschitz Continuitycited by 311
- 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
23 more
- 2018Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networkscited by 193
- 2017Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulationcited by 182
- 2020Deep Learning based Vulnerability Detection: Are We There Yet?cited by 142
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
- 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 91
- 2018Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approachcited by 89
- 2021Gone Fishing: Neural Active Learning with Fisher Embeddingscited by 88
- 2024Multimodal Alignment and Fusion: A Surveycited by 73
- 2023Large Language Models for Test-Free Fault Localizationcited by 67
- 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
- 2023Prompt-Enhanced Software Vulnerability Detection Using ChatGPTcited by 51
- 2019Getafix: Learning to Fix Bugs Automaticallycited by 40
- 2019Multi-Modal Attention Network Learning for Semantic Source Code Retrievalcited by 40
- 2018The Impact of Class Rebalancing Techniques on the Performance and Interpretation of Defect Prediction Modelscited by 29
- 2018Fisher Information and Natural Gradient Learning of Random Deep Networkscited by 28
- 2021On the Optimality of the Oja's Algorithm for Online PCAcited by 11
- 2024Vul-LMGNNs: Fusing language models and online-distilled graph neural networks for code vulnerability detectioncited by 11
- 2023Code-centric Learning-based Just-In-Time Vulnerability Detectioncited by 8
- 2024Coca: Improving and Explaining Graph Neural Network-Based Vulnerability Detection Systemscited by 8
- 2021VulSPG: Vulnerability detection based on slice property graph representation learningcited by 7
- 2024Integrating Various Software Artifacts for Better LLM-based Bug Localization and Program Repaircited by 4
- 2025Propagation-Based Vulnerability Impact Assessment for Software Supply Chainscited by 2
Built on by
Not cited yet.