Multi-modal Image and Radio Frequency Fusion for Optimizing Vehicle Positioning
Not on the map. Why?
Abstract (arXiv)
In this paper, a multi-modal vehicle positioning framework that jointly localizes vehicles with channel state information (CSI) and images is designed. In particular, we consider an outdoor scenario where each vehicle can communicate with only one BS, and hence, it can upload its estimated CSI to only its associated BS. Each BS is equipped with a set of cameras, such that it can collect a small number of labeled CSI, a large number of unlabeled CSI, and the images taken by cameras. To exploit the unlabeled CSI data and position labels obtained from images, we design an meta-learning based hard expectation-maximization (EM) algorithm. Specifically, since we do not know the corresponding relationship between unlabeled CSI and the multiple vehicle locations in images, we formulate the calculation of the training objective as a minimum matching problem. To reduce the impact of label noises caused by incorrect matching between unlabeled CSI and vehicle locations obtained from images and achieve better convergence, we introduce a weighted loss function on the unlabeled datasets, and study the use of a meta-learning algorithm for computing the weighted loss. Subsequently, the model parameters are updated according to the weighted loss function of unlabeled CSI samples and their matched position labels obtained from images. Simulation results show that the proposed method can reduce the positioning error by up to 61% compared to a baseline that does not use images and uses only CSI fingerprint for vehicle positioning.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 15 Oct 2024.
Builds on
21 of 41 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
- 2019A Joint Learning and Communications Framework for Federated Learning over Wireless Networkscited by 263
- 2021Distributed Learning in Wireless Networks: Recent Progress and Future Challengescited by 129
- 2014Convolutional Neural Networks at Constrained Time Costcited by 81
- 2018Deep Bilevel Learningcited by 49
- 2021Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoffcited by 30
- 2019Millimeter Wave Base Stations with Cameras: Vision Aided Beam and Blockage Predictioncited by 29
- 2022Deep Learning on Multimodal Sensor Data at the Wireless Edge for Vehicular Networkcited by 15
- 2021Computer Vision Aided Beam Tracking in A Real-World Millimeter Wave Deploymentcited by 11
- 2020ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutionscited by 9
9 more
- 2020CSI-Based Multi-Antenna and Multi-Point Indoor Positioning Using Probability Fusioncited by 9
- 2022Computer Vision Aided Blockage Prediction in Real-World Millimeter Wave Deploymentscited by 9
- 2021CSI-Based Localization with CNNs Exploiting Phase Informationcited by 7
- 2018CSI-based Outdoor Localization for Massive MIMO: Experiments with a Learning Approachcited by 6
- 2022Multi-Environment based Meta-Learning with CSI Fingerprints for Radio Based Positioningcited by 6
- 2024Complex-Valued Neural Network based Federated Learning for Multi-user Indoor Positioning Performance Optimizationcited by 6
- 2022Positioning Using Visible Light Communications: A Perspective Arcs Approachcited by 4
- 2021Unsupervised Person Re-Identification with Wireless Positioning under Weak Scene Labelingcited by 3
- 2023Automated Static Camera Calibration with Intelligent Vehiclescited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.