mlsanityData to 14 Oct 2026

FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection

arXiv 2609.29125 ↗First posted 24 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In aerial RGB--IR object detection, effectively exploiting complementary information across modalities is critical for robust perception under complex illumination and environmental conditions. Existing multimodal detectors mainly focus on spatial-domain interaction or frequency-specific feature enhancement, while the cross-modal interaction patterns of different frequency components remain insufficiently explored. Moreover, spectral discrepancy itself may contain both useful complementary cues and unreliable modality-specific responses, making indiscriminate frequency fusion suboptimal. To address these issues, we propose FoCal, a frequency-oriented framework for aerial RGB--IR object detection. First, a Frequency-Aware Dual-Domain Calibration (FADC) module is developed to explicitly model frequency-dependent cross-modal interaction. Low-frequency components are collaboratively consolidated into a shared structural consensus, whereas high-frequency components preserve modality-specific information through selective cross-modal exchange. The resulting frequency-aware cues are further transferred to the original feature domain to regulate cross-modal calibration. Second, we introduce a Discrepancy-Guided Spectral Modulation (DGSM) module, which characterizes cross-modal spectral imbalance using confidence-weighted relative amplitude discrepancy and transforms it into a bounded signed gate for adaptive enhancement, preservation, or attenuation of the joint multimodal spectrum. Extensive experiments on DroneVehicle, ESCVehicle, and ATR-UMOD demonstrate the effectiveness of FoCal, yielding mAP50 values of 83.5%, 54.8%, and 64.6%, respectively. Meanwhile, with only 3.0M parameters, FoCal achieves 113.6 FPS while preserving leading detection accuracy, highlighting a favorable accuracy--efficiency trade-off. Code is available at https://github.com/universeliang/FoCal.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 48 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

22 of 48 references.

References · 22

  1. 2021Oriented R-CNN for Object Detectioncited by 231
  2. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  3. 2021ReDet: A Rotation-equivariant Detector for Aerial Object Detectioncited by 203
  4. 2020Align Deep Features for Oriented Object Detectioncited by 187
  5. 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
  6. 2021Learning High-Precision Bounding Box for Rotated Object Detection via Kullback-Leibler Divergencecited by 130
  7. 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
  8. 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
  9. 2024Wavelet Convolutions for Large Receptive Fieldscited by 74
  10. 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
  11. 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 58
  12. 2022SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagerycited by 47
10 more
  1. 2021Cross-Modality Attentive Feature Fusion for Object Detection in Multispectral Remote Sensing Imagerycited by 45
  2. 2024MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusioncited by 35
  3. 2024HS-FPN: High Frequency and Spatial Perception FPN for Tiny Object Detectioncited by 22
  4. 2024COMO: Cross-Mamba Interaction and Offset-Guided Fusion for Multimodal Object Detectioncited by 18
  5. 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
  6. 2025Rethinking Multi-Modal Object Detection from the Perspective of Mono-Modality Feature Learningcited by 11
  7. 2024FD2-Net: Frequency-Driven Feature Decomposition Network for Infrared-Visible Object Detectioncited by 10
  8. 2024SFDFusion: An Efficient Spatial-Frequency Domain Fusion Network for Infrared and Visible Image Fusioncited by 6
  9. 2025Fusion Meets Diverse Conditions: A High-diversity Benchmark and Baseline for UAV-based Multimodal Object Detection with Condition Cuescited by 6
  10. 2025DEPFusion: Dual-Domain Enhancement and Priority-Guided Mamba Fusion for UAV Multispectral Object Detectioncited by 2

Built on by

Not cited yet.