mlsanityData to 14 Oct 2026

HELIX: Hybrid Encoding with Learnable Identity and Cross-dimensional Synthesis for Time Series Imputation

arXiv 2605.02278 ↗First posted 4 May 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Time series imputation benefits from leveraging cross-feature correlations, yet existing attention-based methods re-discover feature relationships at each layer, lacking persistent anchors to maintain consistent representations. To address this, we propose HELIX, which assigns each feature a learnable feature identity, a persistent embedding that captures intrinsic semantic properties throughout the network. Unlike graph-based methods that rely on predefined topology and assume homogeneous spatial relationships, HELIX learns arbitrary feature dependencies end-to-end from temporal co-variation, naturally handling datasets where features mix spatial locations with semantic variables. Integrated with hybrid temporal-feature attention, HELIX achieves the state-of-the-art performance, surpassing all 16 baselines on 5 public datasets across 21 experimental settings in our evaluation. Furthermore, our mechanistic analysis reveals that HELIX aligns learned feature identities and dependencies with latent physical and semantic structure progressively across layers, demonstrating that it more effectively translates cross-feature structure into imputation accuracy.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 33 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

24 of 33 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  6. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  7. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  8. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  9. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
  10. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
  11. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  12. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
12 more
  1. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  2. 2018BRITS: Bidirectional Recurrent Imputation for Time Seriescited by 290
  3. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
  4. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 208
  5. 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 172
  6. 2022SAITS: Self-Attention-based Imputation for Time Seriescited by 169
  7. 2021Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networkscited by 95
  8. 2023PriSTI: A Conditional Diffusion Framework for Spatiotemporal Imputationcited by 66
  9. 2022Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse Observationscited by 64
  10. 2024Deep Learning for Multivariate Time Series Imputation: A Surveycited by 57
  11. 2023ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputationcited by 50
  12. 2024TSI-Bench: Benchmarking Time Series Imputationcited by 33

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.