LER-YOLO: Reliability-Aware Expert Routing for Misaligned RGB-Infrared UAV Detection
Not on the map. Why?
Abstract (arXiv)
Detecting small unmanned aerial vehicles from RGB-infrared remote-sensing pairs remains challenging due to tiny target scale, cluttered backgrounds, and spatial misalignment between heterogeneous sensors. Existing bimodal detectors often align or fuse features without assessing the reliability of local cross-sensor correspondence, allowing mismatch artifacts to propagate into the detection head. To address this issue, we propose LER-YOLO, a reliability-aware sparse mixture-of-experts framework for misaligned RGB-infrared UAV detection. LER-YOLO first introduces an Uncertainty-Aware Target Alignment module that resamples visible features toward the infrared reference and estimates a spatial reliability map. This reliability prior is then used by a Reliability-Guided Sparse MoE Fusion module to adaptively select k experts from RGB-dominant, infrared-dominant, and interactive fusion experts, enabling trustworthy cross-modal interaction while suppressing unreliable fusion. Experiments on the public MBU benchmark under a YOLOv5s-family protocol show that LER-YOLO achieves 89.7+/-0.2% AP50 over three independent seeds, with a best result of 89.9%. Extensive ablations, parameter-matched comparisons, synthetic-shift evaluations, and complexity analysis demonstrate that the gains mainly come from reliability-guided expert routing rather than increased model capacity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 72 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
42 of 72 references.
References · 42
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2017Deformable Convolutional Networkscited by 1,488
- 2015Spatial Transformer Networkscited by 1,429
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 68
30 more
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 58
- 2024Boosting Consistency in Story Visualization with Rich-Contextual Conditional Diffusion Modelscited by 54
- 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 50
- 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
- 2022SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagerycited by 47
- 2021Anti-UAV: A Large Multi-Modal Benchmark for UAV Trackingcited by 31
- 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselinescited by 27
- 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
- 2024COMO: Cross-Mamba Interaction and Offset-Guided Fusion for Multimodal Object Detectioncited by 18
- 2025MUST: The First Dataset and Unified Framework for Multispectral UAV Single Object Trackingcited by 15
- 2025FBRT-YOLO: Faster and Better for Real-Time Aerial Image Detectioncited by 13
- 2025Securing the Skies: A Comprehensive Survey on Anti-UAV Methods, Benchmarking, and Future Directionscited by 11
- 2024Cocoon: Robust Multi-Modal Perception with Uncertainty-Aware Sensor Fusioncited by 9
- 2022Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalitiescited by 8
- 2024DEYOLO: Dual-Feature-Enhancement YOLO for Cross-Modality Object Detectioncited by 8
- 2025CST Anti-UAV: A Thermal Infrared Benchmark for Tiny UAV Tracking in Complex Scenescited by 8
- 2016Template Matching Advances and Applications in Image Analysiscited by 7
- 2023Investigation of UAV Detection in Images with Complex Backgrounds and Rainy Artifactscited by 7
- 2025Deep learning based infrared small object segmentation: Challenges and future directionscited by 7
- 2025Fusion Meets Diverse Conditions: A High-diversity Benchmark and Baseline for UAV-based Multimodal Object Detection with Condition Cuescited by 6
- 2025MoE3D: Mixture of Experts meets Multi-Modal 3D Understandingcited by 6
- 2024DPDETR: Decoupled Position Detection Transformer for Infrared-Visible Object Detectioncited by 5
- 2025Cross-modal Offset-guided Dynamic Alignment and Fusion for Weakly Aligned UAV Object Detectioncited by 4
- 2025DEPFusion: Dual-Domain Enhancement and Priority-Guided Mamba Fusion for UAV Multispectral Object Detectioncited by 2
- 2025SFFR: Spatial-Frequency Feature Reconstruction for Multispectral Aerial Object Detectioncited by 2
- 2025ATR-UMMIM: A Benchmark Dataset for UAV-Based Multimodal Image Registration under Complex Imaging Conditionscited by 1
- 2025YOLO Meets Mixture-of-Experts: Adaptive Expert Routing for Robust Object Detectioncited by 1
- 2026AW-MoE: All-Weather Mixture of Experts for Robust Multi-Modal 3D Object Detectioncited by 1
- 2026SegFly: A Dataset and 2D-3D-2D Paradigm for Aerial RGB-Thermal Semantic Segmentation at Scalecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Bridging Multimodal Fusion and Expert Routing via Spectral Reliability Descriptors for Robust Object Detection
- 2025MambaRefine-YOLO: A Dual-Modality Small Object Detector for UAV Imagery
- 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains
- 2026HDMamba-YOLO: Efficient State-Space Perception and Local Spatial Reconstruction for UAV Small Object
- 2025Multispectral Detection Transformer with Infrared-Centric Feature Fusion
- 2026Denoising-Enhanced Coarse-to-Fine Infrared Small Target Detection with Attention Prior-Guided Knowledge Distillation
- 2025Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation
- 2026YOLO12-MambaScan: An Efficient Object Detector with High-Frequency Enhancement and State-Space Modeling