mlsanityData to 14 Oct 2026

LWM-CDE: A Representation Space for Wireless Data Reasoning and Transferability

arXiv 2605.24077 ↗First posted 22 May 2026eess.SP cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine learning deployments in real-world wireless communication tasks face significant generalization challenges due to location and environment-specific signal structure, high diversity in data across different deployments, and limited availability of real-world data. Current approaches for assessing data similarity between training and inference (deployment) distributions, as well as evaluating model transferability, suffer from high computational costs and inconsistent performance, leaving critical model deployment and model life cycle management decisions without a principled foundation. To address this, we introduce a dataset similarity framework built upon the feature space of a pretrained wireless foundation model. Our method, LWM-CDE (Contrastive learning of Dataset Embedding), fine-tunes the dataset embeddings of the foundation model using a combination of contrastive and geometry-shaping losses, creating a structured manifold where distance reliably indicates transferability. Extensive experiments on wireless benchmarks show that LWM-CDE achieves stronger correlation with empirical transfer performance than existing metrics while being more computationally efficient. The learned representation space supports more effective and data-efficient decision-making for tasks like source dataset selection, label-aware augmentation, and budgeted pretraining, demonstrating its broader utility across different wireless communication applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 50 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

41 of 50 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
  9. 2016Deep Learning with Differential Privacycited by 2,728
  10. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  11. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  12. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
29 more
  1. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  2. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  3. 2019Fantastic Generalization Measures and Where to Find Themcited by 513
  4. 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
  5. 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 226
  6. 2019Generalized Sliced Wasserstein Distancescited by 208
  7. 2019Task2Vec: Task Embedding for Meta-Learningcited by 205
  8. 2019DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applicationscited by 123
  9. 2024MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Modelscited by 100
  10. 2022The Geometry of Multilingual Language Model Representationscited by 95
  11. 2019Representation Similarity Analysis for Efficient Task taxonomy & Transfer Learningcited by 86
  12. 2022Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulationscited by 44
  13. 2019Deep Learning for mmWave Beam and Blockage Prediction Using Sub-6GHz Channelscited by 42
  14. 2018Channel Charting: Locating Users within the Radio Environment using Channel State Informationcited by 40
  15. 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
  16. 2024Large Wireless Model (LWM): A Foundation Model for Wireless Channelscited by 40
  17. 2025WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communicationcited by 40
  18. 2020Fast and Eager k-Medoids Clustering: O(k) Runtime Improvement of the PAM, CLARA, and CLARANS Algorithmscited by 36
  19. 2024WiFo: Wireless Foundation Model for Channel Predictioncited by 29
  20. 2022Wasserstein Task Embedding for Measuring Task Similaritiescited by 25
  21. 2023RankCSE: Unsupervised Sentence Representations Learning via Learning to Rankcited by 23
  22. 2025Language Models Improve When Pretraining Data Matches Target Taskscited by 19
  23. 2021Transfer Learning for Future Wireless Networks: A Comprehensive Surveycited by 18
  24. 2020Triplet-Based Wireless Channel Charting: Architecture and Experimentscited by 17
  25. 2023Understanding the Transferability of Representations via Task-Relatednesscited by 11
  26. 2026LWM-Temporal: Sparse Spatio-Temporal Attention for Wireless Channel Representation Learningcited by 5
  27. 2026LWM-Spectro: A Foundation Model for Wireless Baseband Signal Spectrogramscited by 3
  28. 2024A Dataset Similarity Evaluation Framework for Wireless Communications and Sensingcited by 2
  29. 2026Wireless Dataset Similarity: Measuring Distances in Supervised and Unsupervised Machine Learningcited by 1

Built on by

Not cited yet.