Information Science Principles of Machine Learning: A Causal Chain Meta-Framework Based on Formalized Information Mapping
Not on the map. Why?
Abstract (arXiv)
This paper addresses the current lack of a unified formal framework in machine learning theory, as well as the absence of robust theoretical foundations for interpretability and ethical safety assurance. We first construct a formal information model, employing sets of well-formed formulas (WFFs) to explicitly define the ontological states and carrier mappings for the core components of machine learning. By introducing learnable and processable predicates, as well as learning and processing functions, we analyze the logical inference and constraint rules underlying causal chains in models, thereby establishing the Machine Learning Theory Meta-Framework (MLT-MF). Building upon this framework, we propose universal definitions for model interpretability and ethical safety, and rigorously prove and validate four key theorems: the equivalence between model interpretability and information existence, the constructive formulation of ethical safety assurance and two types of total variation distance (TVD) upper bounds. This work overcomes the limitations of previous fragmented approaches, providing a unified theoretical foundation from an information science perspective to systematically address the critical challenges currently facing machine learning.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 63 references that are in the map. First posted on arXiv 19 May 2025.
Builds on
26 of 63 references.
References · 26
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2016Understanding deep learning requires rethinking generalizationcited by 1,674
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2023Textbooks Are All You Needcited by 569
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 503
- 2017High-dimensional dynamics of generalization error in neural networkscited by 241
- 2021User-friendly introduction to PAC-Bayes boundscited by 239
- 2016Model-Agnostic Interpretability of Machine Learningcited by 219
14 more
- 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
- 2016Research Priorities for Robust and Beneficial Artificial Intelligencecited by 74
- 2021A Survey on Interpretable Reinforcement Learningcited by 73
- 2024Convergence Analysis of Probability Flow ODE for Score-based Generative Modelscited by 57
- 2021Tighter expected generalization error bounds via Wasserstein distancecited by 43
- 2021Guidance on the Assurance of Machine Learning in Autonomous Systems (AMLAS)cited by 42
- 2023Why Does Little Robustness Help? A Further Step Towards Understanding Adversarial Transferabilitycited by 32
- 2022Worldwide AI Ethics: a review of 200 guidelines and recommendations for AI governancecited by 28
- 2019An Information Theoretic Interpretation to Deep Neural Networkscited by 19
- 2022Management of Machine Learning Lifecycle Artifacts: A Surveycited by 13
- 2024The Method of Gaps: Exact Expressions for the Generalization Error of Supervised Learning Algorithmscited by 5
- 2023A Unified View of Deep Learning for Reaction and Retrosynthesis Prediction: Current Status and Future Challengescited by 4
- 2025General Information Metrics for Improving AI Model Training Efficiencycited by 4
- 2022Ethics in AI through the Practitioner's View: A Grounded Theory Literature Reviewcited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.