Complex-Valued Unitary Representations as Classification Heads for Improved Uncertainty Quantification in Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
Modern deep neural networks achieve high predictive accuracy but remain poorly calibrated: their confidence scores do not reliably reflect the true probability of correctness. We propose a quantum-inspired classification head architecture that projects backbone features into a complex-valued Hilbert space and evolves them under a learned unitary transformation parameterised via the Cayley map. Through a controlled hybrid experimental design - training a single shared backbone and comparing lightweight interchangeable heads - we isolate the effect of complex-valued unitary representations on calibration. Our ablation study on CIFAR-10 reveals that the unitary magnitude head (complex features evolved under a Cayley unitary, read out via magnitude and softmax) achieves an Expected Calibration Error (ECE) of 0.0146, representing a 2.4x improvement over a standard softmax head (0.0355) and a 3.5x improvement over temperature scaling (0.0510). Surprisingly, replacing the softmax readout with a Born rule measurement layer - the quantum-mechanically motivated approach - degrades calibration to an ECE of 0.0819. On the CIFAR-10H human-uncertainty benchmark, the wave function head achieves the lowest KL-divergence (0.336) to human soft labels among all compared methods, indicating that complex-valued representations better capture the structure of human perceptual ambiguity. We provide theoretical analysis connecting norm-preserving unitary dynamics to calibration through feature-space geometry, report negative results on out-of-distribution detection and sentiment analysis to delineate the method's scope, and discuss practical implications for safety-critical applications. Code is publicly available.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 69 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
39 of 69 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
27 more
- 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
- 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
- 2019Measuring Calibration in Deep Learningcited by 443
- 2021Revisiting the Calibration of Modern Neural Networkscited by 387
- 2020Calibrating Deep Neural Networks using Focal Losscited by 353
- 2019Verified Uncertainty Calibrationcited by 307
- 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
- 2015Unitary Evolution Recurrent Neural Networkscited by 291
- 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 288
- 2019Human uncertainty makes classification more robustcited by 231
- 2017Deep Complex Networkscited by 215
- 2023Challenges and Opportunities in Quantum Machine Learningcited by 202
- 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
- 2016Full-Capacity Unitary Recurrent Neural Networkscited by 90
- 2019Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networkscited by 86
- 2017Orthogonal Recurrent Neural Networks with Scaled Cayley Transformcited by 82
- 2018Towards Quantum Machine Learning with Tensor Networkscited by 74
- 2016Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNscited by 62
- 2018Evaluating Uncertainty Quantification in End-to-End Autonomous Driving Controlcited by 54
- 2020Quantum Natural Language Processing on Near-Term Quantum Computerscited by 39
- 2017Better than Real: Complex-valued Neural Nets for MRI Fingerprintingcited by 30
- 2016On Complex Valued Convolutional Neural Networkscited by 26
- 2025Closed-Loop Transformers: Autoregressive Modeling as Iterative Latent Equilibriumcited by 3
Built on by
Not cited yet.