# Deep Learning Based Channel Covariance Matrix Estimation with User Location and Scene Images

arXiv: https://arxiv.org/abs/2101.07471 · HTML: https://mlsanity.com/paper/2101.07471/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jan 2021.

## Built on by (most cited first, 4 of 4)

- [Terahertz-Band Joint Ultra-Massive MIMO Radar-Communications: Model-Based and Model-Free Hybrid Beamforming](https://mlsanity.com/paper/2103.00328/) (2021)
- [Machine-Learning-Assisted and Real-Time-Feedback-Controlled Growth of InAs/GaAs Quantum Dots](https://mlsanity.com/paper/2306.12898/) (2023)
- [On-Demand Growth of Semiconductor Heterostructures Guided by Physics-Informed Machine Learning](https://mlsanity.com/paper/2408.03508/) (2024)
- [Synesthesia of Machines (SoM)-Enhanced Sub-THz ISAC Transmission for Air-Ground Network](https://mlsanity.com/paper/2506.12831/) (2025)

## Abstract (arXiv)

Channel covariance matrix (CCM) is one critical parameter for designing the communications systems. In this paper, a novel framework of the deep learning (DL) based CCM estimation is proposed that exploits the perception of the transmission environment without any channel sample or the pilot signals. Specifically, as CCM is affected by the user's movement, we design a deep neural network (DNN) to predict CCM from user location and user speed, and the corresponding estimation method is named as ULCCME. A location denoising method is further developed to reduce the positioning error and improve the robustness of ULCCME. For cases when user location information is not available, we propose an interesting way that uses the environmental 3D images to predict the CCM, and the corresponding estimation method is named as SICCME. Simulation results show that both the proposed methods are effective and will benefit the subsequent channel estimation.
