mlsanityData to 7 Oct 2026

StructuredDNA: A Bio-Physical Framework for Energy-Aware Transformer Routing

arXiv 2512.08968 ↗First posted 1 Dec 2025cs.LGcited by 1

On the map: Mixture-of-experts → Expert routing strategies

Abstract (arXiv)

The rapid scaling of large computational models has led to a critical increase in energy and compute costs. Inspired by biological systems where structure and function emerge from low-energy configurations, we introduce StructuredDNA, a sparse architecture framework for modular, energy-aware Transformer routing. StructuredDNA replaces dense Mixture-of-Experts routing with a bio-physical, energy-guided routing layer based on semantic energy minimization. Inputs are dynamically grouped into semantic codons, and routing selects a single expert by minimizing a global energy functional that combines cohesion, uncertainty, and computational cost. We validate StructuredDNA on both specialized (BioASQ) and open-domain benchmarks (WikiText-103). On BioASQ (K = 50), we achieve a 97.7% reduction in Energy Utilization Density (EUD) and a Semantic Stability Index (SSI) of 0.998. We further demonstrate a Semantic Scaling Law on WikiText-103, showing that the architecture generalizes to open domains by scaling expert granularity (K = 2048) while maintaining more than 99% energy efficiency. StructuredDNA thus establishes a robust, domain-agnostic paradigm for future sparse computational frameworks. StructuredDNA provides an explicit link between bio-physical principles and sparse expert routing in Transformer architectures, and points toward future energy-aware, modular, and scalable computational systems. We discuss limitations of this proof-of-concept study and outline directions for scaling the approach to larger models, datasets, and hardware platforms. The StructuredDNA implementation is available at https://github.com/InnoDeep-repos/StructuredDNA .

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Expert routing strategies, one of 12 directions in Mixture-of-experts. Builds on 3 of its 18 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

3 of 18 references.

References · 3

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  3. 2025Small Language Models are the Future of Agentic AIcited by 254

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dissecting Transformers: A CLEAR Perspective towards Green AI
  2. 2025SliceMoE: Routing Embedding Slices Instead of Tokens for Fine-Grained and Balanced Transformer Scaling
  3. 2026Energy-Entropy Regularization: The True Power of Minimal Looped Transformers
  4. 2026Long-Context Aware Upcycling: A New Frontier for Hybrid LLM Scaling
  5. 2026Sparse Token Routing in Efficient Transformers
  6. 2025EdgeFlex-Transformer: Transformer Inference for Edge Devices
  7. 2026Mixture of Chapters: Scaling Learnt Memory in Transformers
  8. 2026LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference