mlsanityData to 7 Oct 2026

x2-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge Space

arXiv 2603.16671 ↗First posted 17 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Estimating dense 2D optical flow and 3D scene flow is essential for dynamic scene understanding. Recent work combines images, LiDAR, and event data to jointly predict 2D and 3D motion, yet most approaches operate in separate heterogeneous feature spaces. Without a shared latent space that all modalities can align to, these systems rely on multiple modality-specific blocks, leaving cross-sensor mismatches unresolved and making fusion unnecessarily complex.Event cameras naturally provide a spatiotemporal edge signal, which we can treat as an intrinsic edge field to anchor a unified latent representation, termed the Event Edge Space. Building on this idea, we introduce x2-Fusion, which reframes multimodal fusion as representation unification: event-derived spatiotemporal edges define an edge-centric homogeneous space, and image and LiDAR features are explicitly aligned in this shared representation.Within this space, we perform reliability-aware adaptive fusion to estimate modality reliability and emphasize stable cues under degradation. We further employ cross-dimension contrast learning to tightly couple 2D optical flow with 3D scene flow. Extensive experiments on both synthetic and real benchmarks show that x2-Fusion achieves state-of-the-art accuracy under standard conditions and delivers substantial improvements in challenging scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 57 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

47 of 57 references.

References · 47

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  4. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  5. 2019Event-based Vision: A Surveycited by 1,010
  6. 2018MINE: Mutual Information Neural Estimationcited by 680
  7. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  8. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  9. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  10. 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
  11. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
  12. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
35 more
  1. 2017Learning Discrete Representations via Information Maximizing Self-Augmented Trainingcited by 149
  2. 2021E-RAFT: Dense Optical Flow from Event Camerascited by 149
  3. 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
  4. 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
  5. 2019HPLFlowNet: Hierarchical Permutohedral Lattice FlowNet for Scene Flow Estimation on Large-scale Point Cloudscited by 108
  6. 2021Neural Scene Flow Priorcited by 91
  7. 2017Attention-Based Multimodal Fusion for Video Descriptioncited by 75
  8. 2020PV-RAFT: Point-Voxel Correlation Fields for Scene Flow Estimation of Point Cloudscited by 74
  9. 2022Learning Dense and Continuous Optical Flow from an Event Cameracited by 59
  10. 2021CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow Estimationcited by 56
  11. 2019FlowNet3D++: Geometric Losses For Deep Scene Flow Estimationcited by 55
  12. 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 54
  13. 2024Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approachcited by 48
  14. 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 47
  15. 2021Edge-aware Guidance Fusion Network for RGB Thermal Scene Parsingcited by 44
  16. 2020Modality Dropout for Improved Performance-driven Talking Facescited by 32
  17. 2021ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integrationcited by 31
  18. 2023RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimationcited by 26
  19. 2024Bring Event into RGB and LiDAR: Hierarchical Visual-Motion Fusion for Scene Flowcited by 15
  20. 2025Unsupervised Joint Learning of Optical Flow and Intensity with Event Camerascited by 10
  21. 2024SparseFusion: Efficient Sparse Multi-Modal Fusion Framework for Long-Range 3D Perceptioncited by 8
  22. 2025MambaFlow: A Novel and Flow-guided State Space Model for Scene Flow Estimationcited by 8
  23. 2025Instance-Level Moving Object Segmentation from a Single Image with Eventscited by 6
  24. 2025Ultra-High-Frequency Harmony: mmWave Radar and Event Camera Orchestrate Accurate Drone Landingcited by 6
  25. 2025Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Applicationcited by 6
  26. 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understandingcited by 5
  27. 2024EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matchingcited by 5
  28. 2025PRE-Mamba: A 4D State Space Model for Ultra-High-Frequent Event Camera Derainingcited by 5
  29. 2025Learning Efficient Meshflow and Optical Flow from Event Camerascited by 4
  30. 2024Event-based Video Frame Interpolation with Edge Guided Motion Refinementcited by 3
  31. 2025Spatially-guided Temporal Aggregation for Robust Event-RGB Optical Flow Estimationcited by 3
  32. 2025Perturbed State Space Feature Encoders for Optical Flow with Event Camerascited by 2
  33. 2025mmE-Loc: Facilitating Accurate Drone Landing with Ultra-High-Frequency Localizationcited by 2
  34. 2025Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging Scenescited by 2
  35. 2025Enabling High-Frequency Cross-Modality Visual Positioning Service for Accurate Drone Landingcited by 1

Built on by

Not cited yet.