Cross-Modal Generation: From Commodity WiFi to High-Fidelity mmWave and RFID Sensing
Not on the map. Why?
Abstract (arXiv)
AIGC has shown remarkable success in CV and NLP, and has recently demonstrated promising potential in the wireless domain. However, significant data imbalance exists across RF modalities, with abundant WiFi data but scarce mmWave and RFID data due to high acquisition cost. This makes it difficult to train high-quality generative models for these data-scarce modalities. In this work, we propose RF-CMG, a diffusion-based cross-modal generative method that leverages data-rich WiFi signals to synthesize high-fidelity RF data for scarce modalities including mmWave and RFID. The key insight of RF-CMG is to decouple cross-modal generation into high-frequency guidance and low-frequency constraint, which respectively learn high-frequency distribution from limited target modality data and preserve the underlying physical structure via low-frequency constraints during generation. On this basis, we introduce a Modality-Guided Embedding (MGE) module to steer the reverse diffusion trajectory toward the target high-frequency distribution, and a Low-Frequency Modality Consistency (LFMC) module to progressively enforce low-frequency constraints to suppress the accumulation of source-modality structural biases during inference, enabling high-quality target-modality generation. Performance comparison with several prevalent generative models demonstrates that RF-CMG achieves superior performance in synthesizing RFID and mmWave signals. We further showcase the effectiveness of the data generated by RF-CMG in gesture recognition tasks, and analyze the impact of the proportion of synthetic data on downstream performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 55 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
22 of 55 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Generative Adversarial Networkscited by 5,603
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2018Understanding disentangling in β-VAEcited by 332
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2018Transferring GANs: generating images from limited datacited by 134
10 more
- 2023NeRF2: Neural Radio-Frequency Radiance Fieldscited by 56
- 2024RF-Diffusion: Radio Signal Generation via Time-Frequency Diffusioncited by 41
- 2022Progressive Deblurring of Diffusion Models for Coarse-to-Fine Image Synthesiscited by 34
- 2024NeWRF: A Deep Learning Framework for Wireless Radiation Field Reconstruction and Channel Predictioncited by 27
- 2024Generative Diffusion Models for High Dimensional Channel Estimationcited by 26
- 2024NitroFusion: High-Fidelity Single-Step Diffusion through Dynamic Adversarial Trainingcited by 16
- 2023Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaptioncited by 11
- 2024Generative Artificial Intelligence Assisted Wireless Sensing: Human Flow Detection in Practical Communication Environmentscited by 9
- 2025DogFit: Domain-guided Fine-tuning for Efficient Transfer Learning of Diffusion Modelscited by 4
- 2025Uni-DAD: Unified Distillation and Adaptation of Diffusion Models for Few-step Few-shot Image Generationcited by 2
Built on by
Not cited yet.