mlsanityData to 14 Oct 2026

H-Model: Dynamic Neural Architectures for Adaptive Processing

arXiv 2511.11669 ↗First posted 11 Nov 2025cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This article explores the design and experimentation of a neural network architecture capable of dynamically adjusting its internal structure based on the input data. The proposed model introduces a routing mechanism that allows each layer to influence how its outputs are propagated through the network, enabling iterative and adaptive computation. This concept is loosely inspired by the idea of thought processes and dynamic reasoning, where information flow is conditioned not only on the data itself, but also on the internal state of the system. It is important to note that this work does not aim to compete with state-of-the-art language models in terms of performance. Instead, it presents a conceptual prototype-an architectural framework that opens up a new direction for exploring adaptable and potentially more interpretable networks. The goal is not optimization of existing benchmarks but rather the proposal of a system that can learn not only representations, but also the structure of computation itself. Due to practical constraints in computing resources and data, this study remains a preliminary investigation. Nevertheless, initial observations show promise, and the architecture's full potential can only be evaluated in future experiments under more favorable computational conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

18 of 24 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  9. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  10. 2014Going Deeper with Convolutionscited by 4,241
  11. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  12. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
6 more
  1. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  2. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  3. 2017Dynamic Routing Between Capsulescited by 689
  4. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  5. 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 324
  6. 2018A Unified Model for Extractive and Abstractive Summarization using Inconsistency Losscited by 47

Built on by

Not cited yet.