TRACE: Trajectory Recovery for Continuous Mechanism Evolution in Causal Representation Learning
Not on the map. Why?
Abstract (arXiv)
Temporal causal representation learning methods assume that causal mechanisms switch instantaneously between discrete domains, yet real-world systems often exhibit continuous mechanism transitions. For example, a vehicle's dynamics evolve gradually through a turning maneuver, and human gait shifts smoothly from walking to running. We formalize this setting by modeling transitional mechanisms as convex combinations of finitely many atomic mechanisms, governed by time-varying mixing coefficients. Our theoretical contributions establish that both the latent causal variables and the continuous mixing trajectory are jointly identifiable. We further propose TRACE, a Mixture-of-Experts framework where each expert learns one atomic mechanism during training, enabling recovery of mechanism trajectories at test time. This formulation generalizes to intermediate mechanism states never observed during training. Experiments on synthetic and real-world data demonstrate that TRACE recovers mixing trajectories with up to 0.99 correlation, substantially outperforming discrete-switching baselines.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 39 of its 69 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
39 of 69 references.
References · 39
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2016Density estimation using Real NVPcited by 2,029
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2015Return of Frustratingly Easy Domain Adaptationcited by 389
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2016Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICAcited by 270
- 2018The Unmanned Aerial Vehicle Benchmark: Object Detection and Trackingcited by 207
27 more
- 2024OpenMoE: An Early Effort on Open Mixture-of-Experts Language Modelscited by 185
- 2019Causal Discovery from Heterogeneous/Nonstationary Data with Independent Changescited by 166
- 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 132
- 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 96
- 2021Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformercited by 69
- 2024Causal Representation Learning from Multiple Distributions: A General Settingcited by 67
- 2022Temporally Disentangled Representation Learningcited by 59
- 2013Adaptive piecewise polynomial estimation via trend filteringcited by 47
- 2019Collapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systemscited by 26
- 2023Temporally Disentangled Representation Learning under Unknown Nonstationaritycited by 21
- 2024CaRiNG: Learning Temporal Causal Representation under Non-Invertible Generation Processcited by 20
- 2025Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecastingcited by 19
- 2024On the Identification of Temporally Causal Representation with Instantaneous Dependencecited by 15
- 2024Causal Temporal Representation Learning with Nonstationary Sparse Transitioncited by 12
- 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 12
- 2024Infant Agent: A Tool-Integrated, Logic-Driven Agent with Cost-Effective API Usagecited by 11
- 2024Interpolating Video-LLMs: Toward Longer-sequence LMMs in a Training-free Mannercited by 10
- 2025Glocal Information Bottleneck for Time Series Imputationcited by 9
- 2021Large sample spectral analysis of graph-based multi-manifold clusteringcited by 8
- 2024From Correlation to Causation: Max-Pooling-Based Multi-Instance Learning Leads to More Robust Whole Slide Image Classificationcited by 7
- 2024HACSurv: A Hierarchical Copula-Based Approach for Survival Analysis with Dependent Competing Riskscited by 7
- 2025InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer Interactioncited by 7
- 2025Towards Identifiability of Hierarchical Temporal Causal Representation Learningcited by 7
- 2025Enhancing Dance-to-Music Generation via Negative Conditioning Latent Diffusion Modelcited by 5
- 2025Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learningcited by 4
- 2021Deep Switching State Space Model (DS3M) for Nonlinear Time Series Forecasting with Regime Switchingcited by 3
- 2024Differentiable Causal Discovery For Latent Hierarchical Causal Modelscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MOSAIC: Module Discovery via Sparse Additive Identifiable Causal Learning for Scientific Time Seriescited by 1
- 2026Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifoldscited by 0
- 2026Disentangling Continuous-Time Latent Dynamics: Identifiability of Latent SDEs via Diffusion Shiftscited by 0
- 2026TimeEvo: Failure-Driven Self-Evolution of a Time Series Agentcited by 0
- 2026TimeEvo: Failure-Driven Self-Evolution of a Time Series Agent23 Sep 2026
- 2026Disentangling Continuous-Time Latent Dynamics: Identifiability of Latent SDEs via Diffusion Shifts26 Jun 2026
- 2026Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds15 May 2026
- 2026MOSAIC: Module Discovery via Sparse Additive Identifiable Causal Learning for Scientific Time Series6 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?
- 2026Causal Retention in Interactive Agents: Interface Factorization and Selective Adaptation
- 2026Identifiable World Models from Pretrained Diffusion Representations
- 2023Interpretable Imitation Learning with Dynamic Causal Relations
- 2025Causal Process Models: Reframing Dynamic Causal Graph Discovery as a Reinforcement Learning Problem
- 2025Causal Imitation Learning under Expert-Observable and Expert-Unobservable Confounding
- 2020Causal Transfer for Imitation Learning and Decision Making under Sensor-shift
- 2026Ada-Diffuser: Latent-Aware Adaptive Diffusion for Decision-Making