StructuredDNA: A Bio-Physical Framework for Energy-Aware Transformer Routing
On the map: Mixture-of-experts → Expert routing strategies
Abstract (arXiv)
The rapid scaling of large computational models has led to a critical increase in energy and compute costs. Inspired by biological systems where structure and function emerge from low-energy configurations, we introduce StructuredDNA, a sparse architecture framework for modular, energy-aware Transformer routing. StructuredDNA replaces dense Mixture-of-Experts routing with a bio-physical, energy-guided routing layer based on semantic energy minimization. Inputs are dynamically grouped into semantic codons, and routing selects a single expert by minimizing a global energy functional that combines cohesion, uncertainty, and computational cost. We validate StructuredDNA on both specialized (BioASQ) and open-domain benchmarks (WikiText-103). On BioASQ (K = 50), we achieve a 97.7% reduction in Energy Utilization Density (EUD) and a Semantic Stability Index (SSI) of 0.998. We further demonstrate a Semantic Scaling Law on WikiText-103, showing that the architecture generalizes to open domains by scaling expert granularity (K = 2048) while maintaining more than 99% energy efficiency. StructuredDNA thus establishes a robust, domain-agnostic paradigm for future sparse computational frameworks. StructuredDNA provides an explicit link between bio-physical principles and sparse expert routing in Transformer architectures, and points toward future energy-aware, modular, and scalable computational systems. We discuss limitations of this proof-of-concept study and outline directions for scaling the approach to larger models, datasets, and hardware platforms. The StructuredDNA implementation is available at https://github.com/InnoDeep-repos/StructuredDNA .
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Expert routing strategies, one of 12 directions in Mixture-of-experts. Builds on 3 of its 18 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
3 of 18 references.
References · 3
- 2017Attention Is All You Needcited by 59,932
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2025Small Language Models are the Future of Agentic AIcited by 254
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Dissecting Transformers: A CLEAR Perspective towards Green AI
- 2025SliceMoE: Routing Embedding Slices Instead of Tokens for Fine-Grained and Balanced Transformer Scaling
- 2026Energy-Entropy Regularization: The True Power of Minimal Looped Transformers
- 2026Long-Context Aware Upcycling: A New Frontier for Hybrid LLM Scaling
- 2026Sparse Token Routing in Efficient Transformers
- 2025EdgeFlex-Transformer: Transformer Inference for Edge Devices
- 2026Mixture of Chapters: Scaling Learnt Memory in Transformers
- 2026LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference