Preparation of Fractal-Inspired Computational Architectures for Advanced Large Language Model Analysis
Not on the map. Why?
Abstract (arXiv)
This paper proposes FractalNet, a framework based on fractal design principles that automatically generates and evaluates convolutional neural network (CNN) architectures using recursive template patterns. Rather than relying on computationally expensive Neural Architecture Search (NAS) methods, the framework explores a structured architecture space defined by recursive fractal templates that systematically vary key parameters such as fractal depth, column width, and layer configurations. The framework consists of three core components: a generator that produces candidate architectures via controlled permutations of convolutional, normalization, activation, and dropout layers; a fractal template module that enforces recursive multi-path structural patterns; and a runner module that manages model training, evaluation, and logging. Using this system, over 1,200 distinct CNN architectures were automatically generated and evaluated on the CIFAR-10 image classification benchmark. Training was performed in PyTorch using stochastic gradient descent with Automatic Mixed Precision (AMP) and gradient checkpointing to reduce computational overhead. Experimental results demonstrate that fractal-based architectures exhibit stable training dynamics and achieve competitive performance, with an average validation accuracy of 60-70% and a peak accuracy of 80.18% after only five training epochs. These findings suggest that recursive fractal structures provide an effective means of balancing network depth and width while supporting large-scale automated architecture exploration. The proposed framework offers a resource-efficient and interpretable approach to systematic neural architecture experimentation.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 6 of its 24 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
6 of 24 references.
References · 6
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
- 2025Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?cited by 21
- 2025LEMUR Neural Network Dataset: Towards Seamless AutoMLcited by 20
- 2025VIST-GPT: Ushering in the Era of Visual Storytelling with LLMs?cited by 11
- 2025AugmentGest: Can Random Data Cropping Augmentation Boost Gesture Recognition Performance?cited by 10
Built on by
Citing papers per year: 2025: 3; 2026: 8.
11 papers.
- 2025A Retrieval-Augmented Generation Approach to Extracting Algorithmic Logic from Neural Networkscited by 11
- 2025Enhancing LLM-Based Neural Network Generation: Few-Shot Prompting and Efficient Validation for Automated Architecture Designcited by 10
- 2026From Memorization to Creativity: LLM as a Designer of Novel Neural Architecturescited by 10
- 2025LLM as a Neural Architect: Controlled Generation of Image Captioning Models Under Strict API Contractscited by 9
- 2026From Brute Force to Semantic Insight: Performance-Guided Data Transformation Design with LLMscited by 7
- 2026Resource-Efficient Iterative LLM-Based NAS with Feedback Memorycited by 7
- 2026Closed-Loop LLM Discovery of Non-Standard Channel Priors in Vision Modelscited by 6
- 2026Delta-Based Neural Architecture Search: LLM Fine-Tuning via Code Diffscited by 3
- 2026LEMUR 2: Unlocking Neural Network Diversity for AIcited by 2
- 2026Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Searchcited by 1
- 2026Towards Robust Training in NNGPT AutoML Pipeline: A Loss-Optimizer Pairing Selection Studycited by 0
- 2026LEMUR 2: Unlocking Neural Network Diversity for AI7 Jul 2026
- 2026Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search21 Jun 2026
- 2026Towards Robust Training in NNGPT AutoML Pipeline: A Loss-Optimizer Pairing Selection Study18 Jun 2026
- 2026Delta-Based Neural Architecture Search: LLM Fine-Tuning via Code Diffs6 May 2026
- 2026Resource-Efficient Iterative LLM-Based NAS with Feedback Memory12 Mar 2026
- 2026Closed-Loop LLM Discovery of Non-Standard Channel Priors in Vision Models13 Jan 2026
- 2026From Brute Force to Semantic Insight: Performance-Guided Data Transformation Design with LLMs7 Jan 2026
- 2026From Memorization to Creativity: LLM as a Designer of Novel Neural Architectures6 Jan 2026
- 2025Enhancing LLM-Based Neural Network Generation: Few-Shot Prompting and Efficient Validation for Automated Architecture Design30 Dec 2025
- 2025LLM as a Neural Architect: Controlled Generation of Image Captioning Models Under Strict API Contracts7 Dec 2025
- 2025A Retrieval-Augmented Generation Approach to Extracting Algorithmic Logic from Neural Networks3 Dec 2025