mlsanityData to 14 Oct 2026

Exact ReLU realization of affine one-dimensional refinement iterates via residual memory and offset frames

arXiv 2607.20586 ↗First posted 22 Jul 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We study vector-valued affine refinement operators of the form [ (Wγ)(t)=sum_j∈mathbbZ Ajγ(Mt-j)+B(t), ] with finitely supported matrix mask and compactly supported continuous piecewise linear input and forcing data. Building on the homogeneous realization theorem for (Bequiv 0), we prove that, for (M≥ 3), every finite affine iterate (Wnγ) admits an exact fixed-width ReLU realization whose depth is (O(n)). The main new ingredient is a residual memory controller. It replaces the noninvertible residual dynamics by an injective skew-product and permits exact backward replay of the residual states required by a Horner-type evaluation of the affine forcing sum. Offset frames align the forcing atoms away from residual seams, allowing complementary loop readouts to recover their values exactly. The remaining branch-selection ambiguity occurs only where the accumulated affine state has already vanished. For (M≥ 3), the result applies to arbitrary compactly supported continuous piecewise linear forcing terms. For (M=2), the same construction applies to ordinary-frame seam-separated forcing. We also prove a stage-dependent extension for forcing terms in a fixed finite-dimensional continuous piecewise linear span and record the resulting linear-depth upgrade for open-curve, finite-state, and Hilbert- and Morton-type recursive constructions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 3 of its 10 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

3 of 10 references.

References · 3

  1. 2021Neural Network Approximation of Refinable Functionscited by 15
  2. 2019Expression of Fractals Through Neural Network Functionscited by 8
  3. 2026Exact Loop Controllers for ReLU Realization of Homogeneous Curve Refinementscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.