mlsanityData to 7 Oct 2026

Complex-Valued Unitary Representations as Classification Heads for Improved Uncertainty Quantification in Deep Neural Networks

arXiv 2602.15283 ↗First posted 17 Feb 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern deep neural networks achieve high predictive accuracy but remain poorly calibrated: their confidence scores do not reliably reflect the true probability of correctness. We propose a quantum-inspired classification head architecture that projects backbone features into a complex-valued Hilbert space and evolves them under a learned unitary transformation parameterised via the Cayley map. Through a controlled hybrid experimental design - training a single shared backbone and comparing lightweight interchangeable heads - we isolate the effect of complex-valued unitary representations on calibration. Our ablation study on CIFAR-10 reveals that the unitary magnitude head (complex features evolved under a Cayley unitary, read out via magnitude and softmax) achieves an Expected Calibration Error (ECE) of 0.0146, representing a 2.4x improvement over a standard softmax head (0.0355) and a 3.5x improvement over temperature scaling (0.0510). Surprisingly, replacing the softmax readout with a Born rule measurement layer - the quantum-mechanically motivated approach - degrades calibration to an ECE of 0.0819. On the CIFAR-10H human-uncertainty benchmark, the wave function head achieves the lowest KL-divergence (0.336) to human soft labels among all compared methods, indicating that complex-valued representations better capture the structure of human perceptual ambiguity. We provide theoretical analysis connecting norm-preserving unitary dynamics to calibration through feature-space geometry, report negative results on out-of-distribution detection and sentiment analysis to delineate the method's scope, and discuss practical implications for safety-critical applications. Code is publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 69 references that are in the map. First posted on arXiv 17 Feb 2026.

Builds on

39 of 69 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  6. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  7. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  8. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  9. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  10. 2020Energy-based Out-of-distribution Detectioncited by 1,296
  11. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
  12. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
27 more
  1. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 813
  2. 2017Deep Bayesian Active Learning with Image Datacited by 812
  3. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  4. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
  5. 2019A Simple Baseline for Bayesian Uncertainty in Deep Learningcited by 555
  6. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
  7. 2019Measuring Calibration in Deep Learningcited by 443
  8. 2021Revisiting the Calibration of Modern Neural Networkscited by 387
  9. 2020Calibrating Deep Neural Networks using Focal Losscited by 353
  10. 2019Verified Uncertainty Calibrationcited by 307
  11. 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 304
  12. 2015Unitary Evolution Recurrent Neural Networkscited by 291
  13. 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 288
  14. 2019Human uncertainty makes classification more robustcited by 231
  15. 2017Deep Complex Networkscited by 215
  16. 2023Challenges and Opportunities in Quantum Machine Learningcited by 202
  17. 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
  18. 2016Full-Capacity Unitary Recurrent Neural Networkscited by 90
  19. 2019Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networkscited by 86
  20. 2017Orthogonal Recurrent Neural Networks with Scaled Cayley Transformcited by 82
  21. 2018Towards Quantum Machine Learning with Tensor Networkscited by 74
  22. 2016Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNscited by 62
  23. 2018Evaluating Uncertainty Quantification in End-to-End Autonomous Driving Controlcited by 54
  24. 2020Quantum Natural Language Processing on Near-Term Quantum Computerscited by 39
  25. 2017Better than Real: Complex-valued Neural Nets for MRI Fingerprintingcited by 30
  26. 2016On Complex Valued Convolutional Neural Networkscited by 26
  27. 2025Closed-Loop Transformers: Autoregressive Modeling as Iterative Latent Equilibriumcited by 3

Built on by

Not cited yet.