From the Pursuit of Universal AGI Architecture to Systematic Approach to Heterogenous AGI: Addressing Alignment, Energy, & AGI Grand Challenges
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) faces a trifecta of grand challenges: the Energy Wall, the Alignment Problem and the Leap from Narrow AI to AGI. We present SAGI, a Systematic Approach to AGI that utilizes system design principles to overcome the energy wall and alignment challenges. This paper asserts that AGI can be realized through multiplicity of design specific pathways and customized through system design rather than a singular overarching architecture. AGI systems may exhibit diver architectural configurations and capabilities, contingent upon their intended use cases. Alignment, a challenge broadly recognized as AIs most formidable, is the one that depends most critically on system design and serves as its primary driving force as a foundational criterion for AGI. Capturing the complexities of human morality for alignment requires architectural support to represent the intricacies of moral decision-making and the pervasive ethical processing at every level, with performance reliability exceeding that of human moral judgment. Hence, requiring a more robust architecture towards safety and alignment goals, without replicating or resembling the human brain. We argue that system design (such as feedback loops, energy and performance optimization) on learning substrates (capable of learning its system architecture) is more fundamental to achieving AGI goals and guarantees, superseding classical symbolic, emergentist and hybrid approaches. Through learning of the system architecture itself, the resulting AGI is not a product of spontaneous emergence but of systematic design and deliberate engineering, with core features, including an integrated moral architecture, deeply embedded within its architecture. The approach aims to guarantee design goals such as alignment, efficiency by self-learning system architecture.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 38 of its 221 references that are in the map. First posted on arXiv 23 Oct 2023.
Builds on
38 of 221 references.
References · 38
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
26 more
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 523
- 2020A Comprehensive Survey of Neural Architecture Search: Challenges and Solutionscited by 254
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2019PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimizationcited by 238
- 2023TPU v4: An Optically Reconfigurable Supercomputer for Machine Learning with Hardware Support for Embeddingscited by 202
- 2021Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020cited by 148
- 2019Principles alone cannot guarantee ethical AIcited by 135
- 2017A Study and Comparison of Human and Deep Learning Recognition Performance Under Visual Distortionscited by 108
- 2017A Survey of Neuromorphic Computing and Neural Networks in Hardwarecited by 85
- 2021TT-Rec: Tensor Train Compression for Deep Learning Recommendation Modelscited by 58
- 2021Brain-inspired computing: We need a master plancited by 51
- 2022The BrainScaleS-2 accelerated neuromorphic system with hybrid plasticitycited by 42
- 2018Symbol Emergence in Cognitive Developmental Systems: a Surveycited by 39
- 2019GraphACT: Accelerating GCN Training on CPU-FPGA Heterogeneous Platformscited by 31
- 2019FPGA-based Accelerators of Deep Learning Networks for Learning and Classification: A Reviewcited by 29
- 2014Surpassing Human-Level Face Verification Performance on LFW with GaussianFacecited by 24
- 2021SVP-CF: Selection via Proxy for Collaborative Filtering Datacited by 14
- 2021NetAdaptV2: Efficient Neural Architecture Search with Fast Super-Network Training and Architecture Optimizationcited by 13
- 2020Deep Q-Network-based Adaptive Alert Threshold Selection Policy for Payment Fraud Systems in Retail Bankingcited by 10
- 2021Financial Crime & Fraud Detection Using Graph Computing: Application Considerations & Outlookcited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.