mlsanityData to 7 Oct 2026

TRACE: Trajectory Recovery for Continuous Mechanism Evolution in Causal Representation Learning

arXiv 2601.21135 ↗First posted 29 Jan 2026cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Temporal causal representation learning methods assume that causal mechanisms switch instantaneously between discrete domains, yet real-world systems often exhibit continuous mechanism transitions. For example, a vehicle's dynamics evolve gradually through a turning maneuver, and human gait shifts smoothly from walking to running. We formalize this setting by modeling transitional mechanisms as convex combinations of finitely many atomic mechanisms, governed by time-varying mixing coefficients. Our theoretical contributions establish that both the latent causal variables and the continuous mixing trajectory are jointly identifiable. We further propose TRACE, a Mixture-of-Experts framework where each expert learns one atomic mechanism during training, enabling recovery of mechanism trajectories at test time. This formulation generalizes to intermediate mechanism states never observed during training. Experiments on synthetic and real-world data demonstrate that TRACE recovers mixing trajectories with up to 0.99 correlation, substantially outperforming discrete-switching baselines.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 39 of its 69 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

39 of 69 references.

References · 39

  1. 2018Neural Ordinary Differential Equationscited by 3,733
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  3. 2016Density estimation using Real NVPcited by 2,029
  4. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  5. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  6. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  7. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  8. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
  9. 2015Return of Frustratingly Easy Domain Adaptationcited by 389
  10. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
  11. 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
  12. 2018The Unmanned Aerial Vehicle Benchmark: Object Detection and Trackingcited by 207
27 more
  1. 2024OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelscited by 185
  2. 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
  3. 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
  4. 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 96
  5. 2021Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformercited by 69
  6. 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
  7. 2022Temporally Disentangled Representation Learningcited by 59
  8. 2013Adaptive piecewise polynomial estimation via trend filteringcited by 47
  9. 2019Collapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systemscited by 26
  10. 2023Temporally Disentangled Representation Learning under Unknown Nonstationaritycited by 21
  11. 2024CaRiNG: Learning Temporal Causal Representation under Non-Invertible Generation Processcited by 20
  12. 2025Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecastingcited by 19
  13. 2024On the Identification of Temporally Causal Representation with Instantaneous Dependencecited by 15
  14. 2024Causal Temporal Representation Learning with Nonstationary Sparse Transitioncited by 12
  15. 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 12
  16. 2024Infant Agent: A Tool-Integrated, Logic-Driven Agent with Cost-Effective API Usagecited by 11
  17. 2024Interpolating Video-LLMs: Toward Longer-sequence LMMs in a Training-free Mannercited by 10
  18. 2025Glocal Information Bottleneck for Time Series Imputationcited by 9
  19. 2021Large sample spectral analysis of graph-based multi-manifold clusteringcited by 8
  20. 2024From Correlation to Causation: Max-Pooling-Based Multi-Instance Learning Leads to More Robust Whole Slide Image Classificationcited by 7
  21. 2024HACSurv: A Hierarchical Copula-Based Approach for Survival Analysis with Dependent Competing Riskscited by 7
  22. 2025InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer Interactioncited by 7
  23. 2025Towards Identifiability of Hierarchical Temporal Causal Representation Learningcited by 7
  24. 2025Enhancing Dance-to-Music Generation via Negative Conditioning Latent Diffusion Modelcited by 5
  25. 2025Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learningcited by 4
  26. 2021Deep Switching State Space Model (DS3M) for Nonlinear Time Series Forecasting with Regime Switchingcited by 3
  27. 2024Differentiable Causal Discovery For Latent Hierarchical Causal Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?
  2. 2026Causal Retention in Interactive Agents: Interface Factorization and Selective Adaptation
  3. 2026Identifiable World Models from Pretrained Diffusion Representations
  4. 2023Interpretable Imitation Learning with Dynamic Causal Relations
  5. 2025Causal Process Models: Reframing Dynamic Causal Graph Discovery as a Reinforcement Learning Problem
  6. 2025Causal Imitation Learning under Expert-Observable and Expert-Unobservable Confounding
  7. 2020Causal Transfer for Imitation Learning and Decision Making under Sensor-shift
  8. 2026Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making