Dywave: Event-Aligned Dynamic Tokenization for Heterogeneous IoT Sensing Signals
Not on the map. Why?
Abstract (arXiv)
Internet of Things (IoT) systems continuously collect heterogeneous sensing signals from ubiquitous sensors to support intelligent applications such as human activity analysis, emotion monitoring, and environmental perception. These signals are inherently non-stationary and multi-scale, posing unique challenges for standard tokenization techniques. This paper proposes Dywave, a dynamic tokenization framework for IoT sensing signals that constructs compact input representations aligned with intrinsic temporal structures and underlying physical events. Dywave leverages wavelet-based hierarchical decomposition, identifies meaningful temporal boundaries corresponding to underlying semantic events, and adaptively compresses redundant intervals while preserving temporal coherence. Extensive evaluations on five real-world IoT sensing datasets across activity recognition, stress assessment, and nearby object detection demonstrate that Dywave outperforms state-of-the-art methods by up to 12% in accuracy, while improving computational efficiency by reducing input token lengths by up to 75% across mainstream sequence models. Moreover, Dywave exhibits improved robustness to domain shifts and varying sequence lengths.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 72 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
35 of 72 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,283
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
23 more
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2022Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistencycited by 246
- 2023Language Model Tokenizers Introduce Unfairness Between Languagescited by 207
- 2023Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Modelscited by 186
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
- 2023LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasterscited by 127
- 2024Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabulariescited by 113
- 2021Hierarchical Transformers Are More Efficient Language Modelscited by 99
- 2016DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processingcited by 84
- 2025SensorLM: Learning the Language of Wearable Sensorscited by 44
- 2024SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Modelcited by 36
- 2025Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settingscited by 35
- 2023FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Spacecited by 31
- 2025LightGTS: A Lightweight General Time Series Forecasting Modelcited by 28
- 2024Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenizationcited by 26
- 2019STFNets: Learning Sensing Signals from the Time-Frequency Perspective with Short-Time Fourier Neural Networkscited by 23
- 2023A Multi-Scale Decomposition MLP-Mixer for Time Series Analysiscited by 10
- 2024Enhancing Masked Time-Series Modeling via Dropping Patchescited by 5
- 2025Foundation Models for CPS-IoT: Opportunities and Challengescited by 5
- 2025Byte Pair Encoding for Efficient Time Series Forecastingcited by 5
- 2025InfoMAE: Pair-Efficient Cross-Modal Alignment for Multimodal Time-Series Sensing Signalscited by 3
- 2025The Maximal Overlap Discrete Wavelet Scattering Transform and Its Application in Classification Taskscited by 1
Built on by
Not cited yet.