LWM-CDE: A Representation Space for Wireless Data Reasoning and Transferability
Not on the map. Why?
Abstract (arXiv)
Machine learning deployments in real-world wireless communication tasks face significant generalization challenges due to location and environment-specific signal structure, high diversity in data across different deployments, and limited availability of real-world data. Current approaches for assessing data similarity between training and inference (deployment) distributions, as well as evaluating model transferability, suffer from high computational costs and inconsistent performance, leaving critical model deployment and model life cycle management decisions without a principled foundation. To address this, we introduce a dataset similarity framework built upon the feature space of a pretrained wireless foundation model. Our method, LWM-CDE (Contrastive learning of Dataset Embedding), fine-tunes the dataset embeddings of the foundation model using a combination of contrastive and geometry-shaping losses, creating a structured manifold where distance reliably indicates transferability. Extensive experiments on wireless benchmarks show that LWM-CDE achieves stronger correlation with empirical transfer performance than existing metrics while being more computationally efficient. The learned representation space supports more effective and data-efficient decision-making for tasks like source dataset selection, label-aware augmentation, and budgeted pretraining, demonstrating its broader utility across different wireless communication applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 50 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
41 of 50 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2016Deep Learning with Differential Privacycited by 2,728
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
29 more
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2019Fantastic Generalization Measures and Where to Find Themcited by 513
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
- 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 226
- 2019Generalized Sliced Wasserstein Distancescited by 208
- 2019Task2Vec: Task Embedding for Meta-Learningcited by 205
- 2019DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applicationscited by 123
- 2024MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Modelscited by 100
- 2022The Geometry of Multilingual Language Model Representationscited by 95
- 2019Representation Similarity Analysis for Efficient Task taxonomy & Transfer Learningcited by 86
- 2022Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulationscited by 44
- 2019Deep Learning for mmWave Beam and Blockage Prediction Using Sub-6GHz Channelscited by 42
- 2018Channel Charting: Locating Users within the Radio Environment using Channel State Informationcited by 40
- 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
- 2024Large Wireless Model (LWM): A Foundation Model for Wireless Channelscited by 40
- 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 40
- 2020Fast and Eager k-Medoids Clustering: O(k) Runtime Improvement of the PAM, CLARA, and CLARANS Algorithmscited by 36
- 2024WiFo: Wireless Foundation Model for Channel Predictioncited by 29
- 2022Wasserstein Task Embedding for Measuring Task Similaritiescited by 25
- 2023RankCSE: Unsupervised Sentence Representations Learning via Learning to Rankcited by 23
- 2025Language Models Improve When Pretraining Data Matches Target Taskscited by 19
- 2021Transfer Learning for Future Wireless Networks: A Comprehensive Surveycited by 18
- 2020Triplet-Based Wireless Channel Charting: Architecture and Experimentscited by 17
- 2023Understanding the Transferability of Representations via Task-Relatednesscited by 11
- 2026LWM-Temporal: Sparse Spatio-Temporal Attention for Wireless Channel Representation Learningcited by 5
- 2026LWM-Spectro: A Foundation Model for Wireless Baseband Signal Spectrogramscited by 3
- 2024A Dataset Similarity Evaluation Framework for Wireless Communications and Sensingcited by 2
- 2026Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learningcited by 1
Built on by
Not cited yet.