Learning Bayesian Networks: The Combination of Knowledge and Statistical Data
Not on the map. Why?
Abstract (arXiv)
We describe algorithms for learning Bayesian networks from a combination of user knowledge and statistical data. The algorithms have two components: a scoring metric and a search procedure. The scoring metric takes a network structure, statistical data, and a user's prior knowledge, and returns a score proportional to the posterior probability of the network structure given the data. The search procedure generates networks for evaluation by the scoring metric. Our contributions are threefold. First, we identify two important properties of metrics, which we call event equivalence and parameter modularity. These properties have been mostly ignored, but when combined, greatly simplify the encoding of a user's prior knowledge. In particular, a user can express her knowledge-for the most part-as a single prior Bayesian network for the domain. Second, we describe local search and annealing algorithms to be used in conjunction with scoring metrics. In the special case where each node has at most one parent, we show that heuristic search can be replaced with a polynomial algorithm to identify the networks with the highest score. Third, we describe a methodology for evaluating Bayesian-network learning algorithms. We apply this approach to a comparison of metrics and search procedures.
Key facts. Cited by 185 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 33; 2023: 34; 2024: 27; 2025: 28; 2026: 27.
185 papers.
Sort:
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
- 2022Bayesian Structure Learning with Generative Flow Networkscited by 153
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2021DiBS: Differentiable Bayesian Structure Learningcited by 105
- 2022Amortized Inference for Causal Structure Learningcited by 89
- 2021A survey of Bayesian Network structure learningcited by 85
- 2022Learning to Induce Causal Structurecited by 68
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
- 2023Integrating Large Language Model for Improved Causal Discoverycited by 54
- 2023Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Networkcited by 50
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2023A Survey on Causal Reinforcement Learningcited by 43
38 more
- 2023Causal Discovery from Temporal Data: An Overview and New Perspectivescited by 43
- 2021Learning Neural Causal Models with Active Interventionscited by 40
- 2022From Statistical to Causal Learningcited by 40
- 2021The impact of prior knowledge on causal structure learningcited by 35
- 2021Interventional Sum-Product Networks: Causal Inference with Tractable Probabilistic Modelscited by 22
- 2022Differentiable Causal Discovery Under Latent Interventionscited by 21
- 2021CausalAF: Causal Autoregressive Flow for Safety-Critical Driving Scenario Generationcited by 20
- 2021Optimally Efficient Sequential Calibration of Binary Classifiers to Minimize Classification Errorcited by 17
- 2023Exploiting Noise as a Resource for Computation and Learning in Spiking Neural Networkscited by 17
- 2025Causally Reliable Concept Bottleneck Modelscited by 17
- 2023Benchmarking and Explaining Large Language Model-based Code Generation: A Causality-Centric Approachcited by 15
- 2021Integer Programming for Causal Structure Learning in the Presence of Latent Variablescited by 14
- 2021Efficient Bayesian network structure learning via local Markov boundary searchcited by 14
- 2022Distributed Learning of Generalized Linear Causal Networkscited by 13
- 2021Greedy structure learning from data that contain systematic missing valuescited by 12
- 2024Building Expressive and Tractable Probabilistic Generative Models: A Reviewcited by 12
- 2024Recursive Causal Discoverycited by 12
- 2024On the Reliability of Large Language Models for Causal Discoverycited by 12
- 2021Benchpress: A Scalable and Versatile Workflow for Benchmarking Structure Learning Algorithmscited by 11
- 2022Neural Graphical Modelscited by 11
- 2022GFlowCausal: Generative Flow Networks for Causal Discoverycited by 11
- 2023Bivariate Causal Discovery using Bayesian Model Selectioncited by 11
- 2021Data-driven discovery of interpretable causal relations for deep learning material laws with uncertainty propagationcited by 10
- 2021Structure learning in polynomial time: Greedy algorithms, Bregman information, and exponential familiescited by 10
- 2023Active causal structure learning with advicecited by 10
- 2023Global Optimality in Bivariate Gradient-based DAG Learningcited by 10
- 2022Polynomial-Time Algorithms for Counting and Sampling Markov Equivalent DAGs with Applicationscited by 9
- 2023Copula-based transferable models for synthetic population generationcited by 9
- 2024bnRep: A repository of Bayesian networks from the academic literaturecited by 9
- 2021Sensitivity and robustness analysis in Bayesian networks with the bnmonitor R packagecited by 8
- 2023Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learningcited by 8
- 2023Applying Large Language Models for Causal Structure Learning in Non Small Cell Lung Cancercited by 8
- 2021Effective and efficient structure learning with pruning and model averaging strategiescited by 7
- 2022Multiscale Causal Structure Learningcited by 7
- 2022Methods for Recovering Conditional Independence Graphs: A Surveycited by 7
- 2023Bayesian Structure Scores for Probabilistic Circuitscited by 7
- 2023Open problems in causal structure learning: A case study of COVID-19 in the UKcited by 7
- 2024A Skewness-Based Criterion for Addressing Heteroscedastic Noise in Causal Discoverycited by 7
50 most cited of 185 All 185 (JSON)
- 2026MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimization25 Sep 2026
- 2026From Static Personal Values to Contextualized Personalization: Bayesian Personalized Value Alignment for LLMs24 Sep 2026
- 2026Probabilistic Modelling of Operational Design Domains, A New Approach for Testing AI Systems21 Sep 2026
- 2026Decoupled Causal Discovery20 Sep 2026
- 2026ABSOL: Aggregated Bayesian Subsampling Orchestrated with LLMs14 Sep 2026
- 2026Causal Modeling of Adverse Pregnancy Outcomes via Adaptive LLM Proposals21 Aug 2026
- 2026The Cost of Binarizing Survival Outcomes in Clinical Prognostic Modeling4 Aug 2026
- 2026A Neurosymbolic Approach for Explainable Early Diagnosis of Alzheimer's Disease31 Jul 2026
- 2026Knowledge-Informed Local Causal Discovery of Optimal Adjustment Sets5 Jul 2026
- 2026Structured Inference with Large Language Gibbs17 Jun 2026
- 2026KG-SoftMAP: Soft Knowledge-Graph Priors for Bayesian Network Structure Learning from Sparse Discrete Data9 Jun 2026
- 2026Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications4 Jun 2026
38 more
- 2026Intercomparison of Machine Learning Algorithms for Remote Sensing-based In-season Crop Mapping4 Jun 2026
- 2026Do Real-World Datasets Contain Natural Experiments? An Empirical Study Using Causal Feature Selection2 Jun 2026
- 2026Consistency evaluation of benchmarks used for causal discovery1 Jun 2026
- 2026Iterative Causal Discovery: Per-Edge Impossibility Certificates, Tier-Aware Oracle Queries, and the 1+K Lower Bound26 May 2026
- 2026Understanding Deterioration Random Effects for Causal Discovery in Infrastructure Management19 May 2026
- 2026PRCD-MAP: Learning How Much to Trust Imperfect Priors in Causal Discovery3 May 2026
- 2026Time series causal discovery with variable lags15 Apr 2026
- 2026Causal-Audit: A Framework for Risk Assessment of Assumption Violations in Time-Series Causal Discovery2 Apr 2026
- 2026Procela: Epistemic Governance in Mechanistic Simulations Under Structural Uncertainty1 Apr 2026
- 2026Causal Discovery Should Embrace the Wisdom of the Crowd3 Mar 2026
- 2026Causal Neural Probabilistic Circuits2 Mar 2026
- 2026Leveraging Large Language Models for Causal Discovery: a Constraint-based, Argumentation-driven Approach18 Feb 2026
- 2026Causal Graph Learning via Distributional Invariance of Cause-Effect Relationship3 Feb 2026
- 2026Causal Preference Elicitation1 Feb 2026
- 2026Ordering-based Causal Discovery via Generalized Score Matching22 Jan 2026
- 2025gfnx: Fast and Scalable Library for Generative Flow Networks in JAX20 Nov 2025
- 2025Causal Discovery on Higher-Order Interactions18 Nov 2025
- 2025Learning Gaussian DAG Models without Condition Number Bounds8 Nov 2025
- 2025Transformers Provably Learn Directed Acyclic Graphs via Kernel-Guided Mutual Information29 Oct 2025
- 2025Scaling Up Bayesian DAG Sampling29 Oct 2025
- 2025The Robustness of Differentiable Causal Discovery in Misspecified Scenarios14 Oct 2025
- 2025IRIS: An Iterative and Integrated Framework for Verifiable Causal Discovery in the Absence of Tabular Data10 Oct 2025
- 2025Incorporating Expert Knowledge into Bayesian Causal Discovery of Mixtures of Directed Acyclic Graphs8 Oct 2025
- 2025Embracing Discrete Search: A Reasonable Approach to Causal Structure Learning6 Oct 2025
- 2025Differentiable Structure Learning and Causal Discovery for General Binary Data25 Sep 2025
- 2025Generalized Deep Multi-view Clustering via Causal Learning with Partially Aligned Cross-view Correspondence19 Sep 2025
- 2025Consistent Bayesian causal discovery for structural equation models with equal error variances18 Sep 2025
- 2025Learning discrete Bayesian networks with hierarchical Dirichlet shrinkage16 Sep 2025
- 2025BaMANI: Bayesian Multi-Algorithm causal Network Inference15 Aug 2025
- 2025From Observations to Causations: A GNN-based Probabilistic Prediction Framework for Causal Discovery27 Jul 2025
- 2025Lower Bounds on the Size of Markov Equivalence Classes26 Jun 2025
- 2025Sequential Causal Discovery with Noisy Language Model Priors19 Jun 2025
- 2025Loss-Guided Auxiliary Agents for Overcoming Mode Collapse in GFlowNets21 May 2025
- 2025Transportability without Graphs: A Bayesian Approach to Identifying s-Admissible Backdoor Sets19 May 2025
- 2025Inexact Column Generation for Bayesian Network Structure Learning via Difference-of-Submodular Optimization16 May 2025
- 2025On the Role of Priors in Bayesian Causal Learning2 Apr 2025
- 2025A Guide to Bayesian Networks Software Packages for Structure and Parameter Learning -- 2025 Edition21 Mar 2025
- 2025Heterogeneous Causal Discovery of Repeated Undesirable Health Outcomes14 Mar 2025
50 newest of 185 All 185 (JSON)
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 209
- 2022Bayesian Structure Learning with Generative Flow Networkscited by 153
- 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
- 2021DiBS: Differentiable Bayesian Structure Learningcited by 105
- 2022Amortized Inference for Causal Structure Learningcited by 89
- 2021A survey of Bayesian Network structure learningcited by 85
- 2022Learning to Induce Causal Structurecited by 68
- 2023GFlowNets for AI-Driven Scientific Discoverycited by 63
- 2023Integrating Large Language Model for Improved Causal Discoverycited by 54
- 2023Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Networkcited by 50
- 2022Adversarial random forests for density estimation and generative modelingcited by 44
- 2023A Survey on Causal Reinforcement Learningcited by 43
12 most cited of 185 All 185 (JSON)
- 2026MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimization25 Sep 2026
- 2026From Static Personal Values to Contextualized Personalization: Bayesian Personalized Value Alignment for LLMs24 Sep 2026
- 2026Probabilistic Modelling of Operational Design Domains, A New Approach for Testing AI Systems21 Sep 2026
- 2026Decoupled Causal Discovery20 Sep 2026
- 2026ABSOL: Aggregated Bayesian Subsampling Orchestrated with LLMs14 Sep 2026
- 2026Causal Modeling of Adverse Pregnancy Outcomes via Adaptive LLM Proposals21 Aug 2026
- 2026The Cost of Binarizing Survival Outcomes in Clinical Prognostic Modeling4 Aug 2026
- 2026A Neurosymbolic Approach for Explainable Early Diagnosis of Alzheimer's Disease31 Jul 2026
- 2026Knowledge-Informed Local Causal Discovery of Optimal Adjustment Sets5 Jul 2026
- 2026Structured Inference with Large Language Gibbs17 Jun 2026
- 2026KG-SoftMAP: Soft Knowledge-Graph Priors for Bayesian Network Structure Learning from Sparse Discrete Data9 Jun 2026
- 2026Discrete Causal Representations from Heterogeneous Domains: A Bayesian Approach with Social Survey Applications4 Jun 2026
12 newest of 185 All 185 (JSON)