mlsanityData to 13 Oct 2026

DAGGER: Gradient-Free Construction of Transiently Amplifying Networks under Hard Connectivity Constraints

arXiv 2606.01227 ↗First posted 31 May 2026cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Many networks not only support but also rely on transient non-normal amplification, an orders-of-magnitude increase in the activity of an otherwise stable system. Constructing such networks under hard sign/sparsity/diagonal constraints -- the regime relevant for biological connectomes and structured RNN initializations -- has so far required either gradient-based local search with thousands of inner-loop eigendecompositions or Schur-form direct construction in an abstract basis that breaks the constraints under projection. Here we introduce DAGGER (Directed Acyclic Graph Guided Edge Reweighting), a gradient-free single-pass algorithm. Given a stable signed sparse matrix, DAGGER produces an output with the same sign, sparsity, and diagonal. A single scalar β controls a Wasserstein-2 budget that smoothly trades exact multiset preservation (β = 0) for amplification; peak amplification grows essentially without bound with β, empirically reaching 1010 before numerical overflow. DAGGER matches or exceeds gradient-based methods at multiset preservation in a single forward pass -- 30-100× fewer eigendecompositions than a typical gradient inner loop -- and at moderate β beats them by orders of magnitude with connectivity exactly preserved. We develop the algorithm, compare it to the existing methods and on a downstream signal-detection task, and examine the diagnostics that show why DAGGER is structurally different from other amplifying networks.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

6 of 20 references.

References · 6

  1. 2015Unitary Evolution Recurrent Neural Networkscited by 291
  2. 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
  3. 2016Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflectionscited by 57
  4. 2019Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamicscited by 28
  5. 2018Coding with transient trajectories in recurrent neural networkscited by 7
  6. 2019Improved memory in recurrent neural networks with sequential non-normal dynamicscited by 7

Built on by

Not cited yet.