What Your Model Threw Away and Why You'll Want It Back: Masking, Fingerprinting, and Privacy from Discarded Geometry
Not on the map. Why?
Abstract (arXiv)
We develop a framework for the information discarded by machine learning models whose inputs carry a Lie group action. Given a representation π of a Lie group G on a space V and a learned function fcolon V → ℝ, we define two objects measuring the symmetry invisible to f. The null fiber at a point x ∈ V is the set NG(f,x) = g ∈ G : f(π(g-1) · x) = f(x) of group elements whose inverse action on x is undetectable by f. When NG(f,x) is independent of x, it coincides with the stabilizer StabG(f), the largest subgroup of G under which f is invariant. For smooth maps to ℝ, the preimage theorem guarantees that null fibers have dimension at least dim G - 1 at generic inputs, regardless of architecture. For compact groups acting on themselves, the Peter--Weyl theorem yields a spectral characterization of both objects in terms of the Fourier coefficient matrices of f. We show that null fiber elements can be computed efficiently via Newton iteration on the orbit map, at a cost comparable to a few gradient evaluations. Applications to data masking, model fingerprinting, and privacy-preserving computation are developed and tested experimentally on molecular property prediction under SO(3) and spherical image classification under the M"obius group PSL(2, mathbbC). The framework applies uniformly to classical neural networks and variational quantum circuits.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
19 of 39 references.
References · 19
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2020Variational Quantum Algorithmscited by 687
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2018Spherical CNNscited by 452
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 296
- 2020Equivariant flow-based sampling for lattice gauge theorycited by 102
- 2019Deep Neural Network Fingerprinting by Conferrable Adversarial Examplescited by 90
7 more
- 2020Sampling using SU(N) gauge equivariant flowscited by 83
- 2021Federated Learning: Opportunities and Challengescited by 83
- 2019IPGuard: Protecting Intellectual Property of Deep Neural Networks via Fingerprinting the Classification Boundarycited by 68
- 2021Geometric Deep Learning and Equivariant Neural Networkscited by 64
- 2022Fingerprinting Deep Neural Networks Globally via Universal Adversarial Perturbationscited by 58
- 2020Outlier Detection through Null Space Analysis of Neural Networkscited by 19
- 2024Null Space Properties of Neural Networks with Applications to Image Steganographycited by 2
Built on by
Not cited yet.