Data-Centric AI Requires Rethinking Data Notion
Not on the map. Why?
Abstract (arXiv)
The transition towards data-centric AI requires revisiting data notions from mathematical and implementational standpoints to obtain unified data-centric machine learning packages. Towards this end, this work proposes unifying principles offered by categorical and cochain notions of data, and discusses the importance of these principles in data-centric AI transition. In the categorical notion, data is viewed as a mathematical structure that we act upon via morphisms to preserve this structure. As for cochain notion, data can be viewed as a function defined in a discrete domain of interest and acted upon via operators. While these notions are almost orthogonal, they provide a unifying definition to view data, ultimately impacting the way machine learning packages are developed, implemented, and utilized by practitioners.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 6 Oct 2021.
Builds on
14 of 32 references.
References · 14
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
- 2015Learning with a Wasserstein Losscited by 194
- 2019Topological Autoencoderscited by 124
- 2020Simplicial Neural Networkscited by 105
- 2018Random Walks on Simplicial Complexes and the normalized Hodge 1-Laplaciancited by 84
- 2021Signal Processing on Higher-Order Networks: Livin' on the Edge ... and Beyondcited by 81
- 2021Principled Simplicial Neural Networks for Trajectory Predictioncited by 77
- 2020Cell Complex Neural Networkscited by 66
- 2021What are higher-order networks?cited by 66
2 more
- 2019HodgeNet: Graph Neural Networks for Edge Datacited by 39
- 2021Simplicial Complex Representation Learningcited by 17
Built on by
Citing papers per year: 2021: 2; 2022: 0; 2023: 4; 2024: 2.
8 papers.
- 2023Teaching Arithmetic to Small Transformerscited by 121
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 65
- 2024Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimationcited by 53
- 2021BScNets: Block Simplicial Complex Neural Networkscited by 21
- 2023AlpaGasus: Training A Better Alpaca with Fewer Datacited by 19
- 2021DataCLUE: A Benchmark Suite for Data-centric NLPcited by 6
- 2023Learning to Select Pivotal Samples for Meta Re-weightingcited by 3
- 2023Provable advantages of kernel-based quantum learners and quantum preprocessing based on Grover's algorithmcited by 3
- 2024Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation28 Feb 2024
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learning14 Feb 2024
- 2023Provable advantages of kernel-based quantum learners and quantum preprocessing based on Grover's algorithm25 Sep 2023
- 2023AlpaGasus: Training A Better Alpaca with Fewer Data17 Jul 2023
- 2023Teaching Arithmetic to Small Transformers7 Jul 2023
- 2023Learning to Select Pivotal Samples for Meta Re-weighting9 Feb 2023
- 2021BScNets: Block Simplicial Complex Neural Networks13 Dec 2021
- 2021DataCLUE: A Benchmark Suite for Data-centric NLP16 Nov 2021