A Distributed and Integrated Method of Moments for High-Dimensional Correlated Data Analysis
Not on the map. Why?
Abstract (arXiv)
This paper is motivated by a regression analysis of electroencephalography (EEG) neuroimaging data with high-dimensional correlated responses with multi-level nested correlations. We develop a divide-and-conquer procedure implemented in a fully distributed and parallelized computational scheme for statistical estimation and inference of regression parameters. Despite significant efforts in the literature, the computational bottleneck associated with high-dimensional likelihoods prevents the scalability of existing methods. The proposed method addresses this challenge by dividing responses into subvectors to be analyzed separately and in parallel on a distributed platform using pairwise composite likelihood. Theoretical challenges related to combining results from dependent data are overcome in a statistically efficient way using a meta-estimator derived from Hansen's generalized method of moments. We provide a rigorous theoretical framework for efficient estimation, inference, and goodness-of-fit tests. We develop an R package for ease of implementation. We illustrate our method's performance with simulations and the analysis of the EEG data, and find that iron deficiency is significantly associated with two auditory recognition memory related potentials in the left parietal-occipital region of the brain.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 3; 2025: 2.
7 papers.
- 2024You Only Acquire Sparse-channel (YOAS): A Unified Framework for Dense-channel EEG Generationcited by 5
- 2023Quasi-Newton Updating for Large-Scale Distributed Learningcited by 2
- 2025Federated Learning of Quantile Inference under Local Differential Privacycited by 2
- 2022CEDAR: Communication Efficient Distributed Analysis for Regressionscited by 1
- 2024A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniquescited by 0
- 2024When the whole is greater than the sum of its parts: Scaling black-box inference to large data settings through divide-and-conquercited by 0
- 2025Efficient Distributed Learning over Decentralized Networks with Convoluted Support Vector Machinecited by 0
- 2025Federated Learning of Quantile Inference under Local Differential Privacy26 Sep 2025
- 2025Efficient Distributed Learning over Decentralized Networks with Convoluted Support Vector Machine10 Mar 2025
- 2024When the whole is greater than the sum of its parts: Scaling black-box inference to large data settings through divide-and-conquer29 Dec 2024
- 2024You Only Acquire Sparse-channel (YOAS): A Unified Framework for Dense-channel EEG Generation21 Jun 2024
- 2024A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques17 Mar 2024
- 2023Quasi-Newton Updating for Large-Scale Distributed Learning7 Jun 2023
- 2022CEDAR: Communication Efficient Distributed Analysis for Regressions1 Jul 2022