Is Class Signal Clustered or Routed in Task-Induced Implicit Neural Representation Weight Spaces?
Not on the map. Why?
Abstract (arXiv)
Implicit neural representations (INRs) encode images as neural-network weights, making image classification a problem of weight-space classifiability. A natural geometric hypothesis is that classifier feedback should make image-specific weights cluster by class in the shared-anchor coordinate. We test this hypothesis in the SIREN-based Meta Weight Transformer (MWT) regime, where end-to-end training meta-learns a shared initialization and inner-loop update schedule for fitting image-specific SIRENs. We find that this prediction fails. Exposed weight-space geometry and supervised clustering pressure do not reliably track trained-reader accuracy; clustering can even make local neighborhoods more class-consistent while making the trained reader worse. Crucially, the reader constructs rather than inherits class-aligned geometry: token-flow diagnostics show that class-aligned neighborhoods become strongly predictive of trained-reader accuracy only after late reader interactions, not in the input coordinate. We further identify the native SIREN bias column in the augmented weight token as a low-dimensional, sample-dependent causal readout route for the trained reader; targeted controls rule out generic scalar-column and marginal-distribution artifacts. The diagnosis motivates interventions that strengthen reader routing, add an explicit bias route, or use denser inner-loop fitting; under the lane-specific training conventions used here, route-directed variants often outperform the shared-anchor baseline but interact non-additively. Task-induced INR weights are classifiable not because they form raw geometric clusters, but because their class signal is routed through the reader.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 41 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
36 of 41 references.
References · 36
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2020Supervised Contrastive Learningcited by 2,803
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2022Editing Models with Task Arithmeticcited by 1,076
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 713
- 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 460
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 377
- 2021The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networkscited by 285
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 183
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2020Predicting Neural Network Accuracy from Weightscited by 107
24 more
- 2023Equivariant Architectures for Learning in Deep Weight Spacescited by 106
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 77
- 2023Permutation Equivariant Neural Functionalscited by 69
- 2022Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weightscited by 63
- 2020Classifying the classifier: dissecting the weight space of neural networkscited by 62
- 2024Graph Neural Networks for Learning Equivariant Representations of Neural Networkscited by 59
- 2023Graph Metanetworks for Processing Diverse Neural Architecturescited by 55
- 2023Neural Functional Transformerscited by 50
- 2022Model Zoos: A Dataset of Diverse Populations of Neural Network Modelscited by 38
- 2023Equivariant Deep Weight Space Alignmentcited by 34
- 2024Universal Neural Functionalscited by 25
- 2024Improved Generalization of Weight Space Networks via Augmentationscited by 24
- 2024Scale Equivariant Graph Metanetworkscited by 23
- 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
- 2024Monomial Matrix Group Equivariant Neural Functional Networkscited by 15
- 2023How to Train Neural Field Representations: A Comprehensive Study and Benchmarkcited by 12
- 2024Implicit-Zoo: A Large-Scale Dataset of Neural Implicit Functions for 2D Images and 3D Scenescited by 12
- 2024Learning on Model Weights using Tree Expertscited by 7
- 2025End-to-End Implicit Neural Representations for Classificationcited by 7
- 2024Encoding Semantic Priors into the Weights of Implicit Neural Representationcited by 3
- 2025ARC: Anchored Representation Clouds for High-Resolution INR Classificationcited by 3
- 2025Bias for Action: Video Implicit Neural Representations with Bias Modulationcited by 2
- 2026Ensuring Semantics in Weights of Implicit Neural Representations through the Implicit Function Theoremcited by 1
Built on by
Not cited yet.