Testing for the Markov Property in Time Series via Deep Conditional Generative Learning
Not on the map. Why?
Abstract (arXiv)
The Markov property is widely imposed in analysis of time series data. Correspondingly, testing the Markov property, and relatedly, inferring the order of a Markov model, are of paramount importance. In this article, we propose a nonparametric test for the Markov property in high-dimensional time series via deep conditional generative learning. We also apply the test sequentially to determine the order of the Markov model. We show that the test controls the type-I error asymptotically, and has the power approaching one. Our proposal makes novel contributions in several ways. We utilize and extend state-of-the-art deep generative learning to estimate the conditional density functions, and establish a sharp upper bound on the approximation error of the estimators. We derive a doubly robust test statistic, which employs a nonparametric estimation but achieves a parametric convergence rate. We further adopt sample splitting and cross-fitting to minimize the conditions required to ensure the consistency of the test. We demonstrate the efficacy of the test through both simulations and the three data applications.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 16 of its 70 references that are in the map. First posted on arXiv 30 May 2023.
Builds on
16 of 70 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2017TensorFlow Distributionscited by 105
- 2015Attribute2Image: Conditional Image Generation from Visual Attributescited by 93
- 2018How Well Generative Adversarial Networks Learn Distributionscited by 78
- 2020Statistical Inference of the Value Function for Reinforcement Learning in Infinite Horizon Settingscited by 65
- 2018Deep Neural Networks for Estimation and Inferencecited by 62
- 2018Deep Neural Networks Learn Non-Smooth Functions Effectivelycited by 57
- 2019Conditional Density Estimation with Neural Networks: Best Practices and Benchmarkscited by 37
- 2020Does the Markov Decision Process Fit the Data: Testing for the Markov Property in Sequential Decision Makingcited by 30
- 2020On Computation and Generalization of Generative Adversarial Imitation Learningcited by 27
4 more
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 2.
9 papers.
- 2024Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experimentscited by 6
- 2024Doubly Robust Conditional Independence Testing with Generative Neural Networkscited by 6
- 2024Model Free Prediction with Uncertainty Assessmentcited by 3
- 2025Statistical Inference in Reinforcement Learning: A Selective Surveycited by 2
- 2024Time Series Generative Learning with Application to Brain Imaging Analysiscited by 0
- 2025A Conditional Distribution Equality Testing Framework using Deep Generative Learningcited by 0
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equationscited by 0
- 2026Integrating Causal DAGs in Deep RL: Activating Minimal Markovian States with Multi-Order Exposurecited by 0
- 2026Generative sequence modeling for infinite memory processes via predictive statescited by 0
- 2026Generative sequence modeling for infinite memory processes via predictive states29 Sep 2026
- 2026Integrating Causal DAGs in Deep RL: Activating Minimal Markovian States with Multi-Order Exposure8 May 2026
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equations15 Dec 2025
- 2025A Conditional Distribution Equality Testing Framework using Deep Generative Learning22 Sep 2025
- 2025Statistical Inference in Reinforcement Learning: A Selective Survey22 Feb 2025
- 2024Doubly Robust Conditional Independence Testing with Generative Neural Networks25 Jul 2024
- 2024Time Series Generative Learning with Application to Brain Imaging Analysis19 Jul 2024
- 2024Model Free Prediction with Uncertainty Assessment21 May 2024
- 2024Unraveling the Interplay between Carryover Effects and Reward Autocorrelations in Switchback Experiments26 Mar 2024