Is merging worth it? Securely evaluating the information gain for causal dataset acquisition
Not on the map. Why?
Abstract (arXiv)
Merging datasets across institutions is a lengthy and costly procedure, especially when it involves private information. Data hosts may therefore want to prospectively gauge which datasets are most beneficial to merge with, without revealing sensitive information. For causal estimation this is particularly challenging as the value of a merge depends not only on reduction in epistemic uncertainty but also on improvement in overlap. To address this challenge, we introduce the first cryptographically secure information-theoretic approach for quantifying the value of a merge in the context of heterogeneous treatment effect estimation. We do this by evaluating the Expected Information Gain (EIG) using multi-party computation to ensure that no raw data is revealed. We further demonstrate that our approach can be combined with differential privacy (DP) to meet arbitrary privacy requirements whilst preserving more accurate computation compared to DP alone. To the best of our knowledge, this work presents the first privacy-preserving method for dataset acquisition tailored to causal estimation. We demonstrate the effectiveness and reliability of our method on a range of simulated and realistic benchmarks. Code is publicly available: https://github.com/LucileTerminassian/causal_prospective_merge.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 81 references that are in the map. First posted on arXiv 11 Sep 2024.
Builds on
21 of 81 references.
References · 21
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 428
- 2019Robust and Communication-Efficient Federated Learning from Non-IID Datacited by 415
- 2017Causal Effect Inference with Deep Latent-Variable Modelscited by 408
- 2017Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processescited by 156
- 2021CrypTen: Secure Multi-Party Computation Meets Machine Learningcited by 131
- 2023Modern Bayesian Experimental Designcited by 121
- 2017On Nesting Monte Carlo Estimatorscited by 82
- 2021Discussion on "Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects" by Hahn, Murray and Carvalhocited by 77
- 2017Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effectscited by 41
- 2022Active Bayesian Causal Inferencecited by 34
9 more
- 2021Causal-BALD: Deep Bayesian Active Learning of Outcomes to Infer Treatment-Effects from Observational Datacited by 27
- 2019Differentially Private Bayesian Linear Regressioncited by 24
- 2020Two-Phase Multi-Party Computation Enabled Privacy-Preserving Federated Learningcited by 19
- 2023An Adaptive Kernel Approach to Federated Learning of Heterogeneous Causal Effectscited by 19
- 2023Differentiable Multi-Target Causal Bayesian Experimental Designcited by 15
- 2022Differentially Private Estimation of Heterogeneous Causal Effectscited by 14
- 2018Structure and Sensitivity in Differential Privacy: Comparing K-Norm Mechanismscited by 9
- 2022Stochastic Tree Ensembles for Estimating Heterogeneous Effectscited by 7
- 2024Disentangle Estimation of Causal Effects from Cross-Silo Datacited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.