Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation
Not on the map. Why?
Abstract (arXiv)
Building pixel-level correspondence between event and image data is a fundamental task for multi-sensor systems. However, existing cross-modal matching methods are largely restricted by their reliance on either matching labels or strictly aligned hardware, which limits them to unlabeled and unconstrained real-world scenarios where neither matching ground truth nor prior sensor relationships are available. To address this, we propose a novel two-stage training paradigm. First, we leverage large-scale data to perform label-agnostic distillation pretraining, upgrading optimization objectives with distribution-based and contrastive losses to learn highly generalizable representations. Second, to tackle unlabeled and unconstrained downstream data, we introduce an epipolar-guided self-distillation framework. By utilizing consistency verification to isolate robust matches and incorporating geometric confidence derived from an external epipolar prior, our model can effectively self-evolve directly on target domains without any supervision. Furthermore, we introduce a rigorous cross-modal evaluation benchmark based on TUM-VIE, featuring physically separated cameras with distinct intrinsic parameters and resolutions. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on both MVSEC and TUM-VIE pose estimation tasks. The source code and benchmark will be made publicly available at https://github.com/ZhonghuaYi/nexus2-official.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
28 of 42 references.
References · 28
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
- 2016The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAMcited by 203
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2023ALIKED: A Lighter Keypoint and Descriptor Extraction Network via Deformable Transformationcited by 121
16 more
- 2024BootsTAP: Bootstrapped Training for Tracking-Any-Pointcited by 120
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 120
- 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110
- 2022Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metriccited by 52
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 48
- 2024MINIMA: Modality Invariant Image Matchingcited by 47
- 2021TUM-VIE: The TUM Stereo Visual-Inertial Event Datasetcited by 41
- 2025TAPNext: Tracking Any Point (TAP) as Next Token Predictioncited by 37
- 2022ReDFeat: Recoupling Detection and Description for Multimodal Feature Learningcited by 26
- 2024Self-Supervised Any-Point Tracking by Contrastive Random Walkscited by 10
- 2025RIPE: Reinforcement Learning on Unlabeled Image Pairs for Robust Keypoint Extractioncited by 9
- 20243MOS: Multi-sources, Multi-resolutions, and Multi-scenes dataset for Optical-SAR image matchingcited by 8
- 2025MapGlue: Multimodal Remote Sensing Image Matchingcited by 5
- 2019Automatic Multi-Sensor Extrinsic Calibration for Mobile Robotscited by 3
- 2024EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Datacited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillation
- 2024EventDance++: Language-guided Unsupervised Source-free Cross-modal Adaptation for Event-based Object Recognition
- 2024LabelDistill: Label-guided Cross-modal Knowledge Distillation for Camera-based 3D Object Detection
- 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
- 2025CovMatch: Cross-Covariance Guided Multimodal Dataset Distillation with Trainable Text Encoder
- 2026Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking