Practical Equivariances via Relational Conditional Neural Processes
Not on the map. Why?
Abstract (arXiv)
Conditional Neural Processes (CNPs) are a class of metalearning models popular for combining the runtime efficiency of amortized inference with reliable uncertainty quantification. Many relevant machine learning tasks, such as in spatio-temporal modeling, Bayesian Optimization and continuous control, inherently contain equivariances -- for example to translation -- which the model can exploit for maximal performance. However, prior attempts to include equivariances in CNPs do not scale effectively beyond two input dimensions. In this work, we propose Relational Conditional Neural Processes (RCNPs), an effective approach to incorporate equivariances into any neural process model. Our proposed method extends the applicability and impact of equivariant neural processes to higher dimensions. We empirically demonstrate the competitive performance of RCNPs on a large array of tasks naturally containing equivariances.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 19 Jun 2023.
Builds on
27 of 44 references.
References · 27
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2017Deep Setscited by 1,421
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
- 2015Deep Kernel Learningcited by 445
- 2018Conditional Neural Processescited by 426
- 2017The Expressive Power of Neural Networks: A View from the Widthcited by 320
- 2018Neural Processescited by 311
- 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
- 2019Attentive Neural Processescited by 283
15 more
- 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
- 2019Convolutional Conditional Neural Processescited by 142
- 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 127
- 2020Building powerful and equivariant graph neural networks with structural message-passingcited by 97
- 2019On the Limitations of Representing Functions on Setscited by 90
- 2020Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural Processescited by 76
- 2021Universal Approximation of Functions on Setscited by 62
- 2021The Gaussian Neural Processcited by 34
- 2023Autoregressive Conditional Neural Processescited by 33
- 2020Equivariant Learning of Stochastic Fields: Gaussian Processes and Steerable Conditional Neural Processescited by 29
- 2022Practical Conditional Neural Processes Via Tractable Dependent Predictionscited by 25
- 2018Exact Reconstruction of Euclidean Distance Geometry Problem Using Low-rank Matrix Completioncited by 18
- 2021Model-based Meta Reinforcement Learning using Graph Structured Surrogate Modelscited by 17
- 2021Group Equivariant Conditional Neural Processescited by 16
- 2021Kernel Identification Through Transformerscited by 13
Built on by
Citing papers per year: 2024: 7; 2025: 4; 2026: 2.
13 papers.
Sort:
- 2024Amortized Probabilistic Conditioning for Optimization, Simulation and Inferencecited by 23
- 2024Amortized Bayesian Experimental Design for Decision-Makingcited by 21
- 2024Translation Equivariant Transformer Neural Processescited by 13
- 2024Approximately Equivariant Neural Processescited by 8
- 2025PABBO: Preferential Amortized Black-Box Optimizationcited by 8
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisitioncited by 8
- 2024Spectral Convolutional Conditional Neural Processescited by 4
- 2025Meta-Statistical Learning: Supervised Learning of Statistical Estimatorscited by 3
- 2024Noise-Aware Differentially Private Regression via Meta-Learningcited by 2
- 2024R'enyi Neural Processescited by 1
- 2025MIST: Mutual Information Estimation Via Supervised Trainingcited by 1
- 2026From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimationcited by 0
1 more
- 2026Revisiting Neural Processes via Fourier Transform and Volterra Series31 May 2026
- 2026From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimation7 May 2026
- 2025MIST: Mutual Information Estimation Via Supervised Training24 Nov 2025
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition8 Jun 2025
- 2025PABBO: Preferential Amortized Black-Box Optimization2 Mar 2025
- 2025Meta-Statistical Learning: Supervised Learning of Statistical Estimators17 Feb 2025
- 2024Amortized Bayesian Experimental Design for Decision-Making4 Nov 2024
- 2024Amortized Probabilistic Conditioning for Optimization, Simulation and Inference20 Oct 2024
- 2024Approximately Equivariant Neural Processes19 Jun 2024
- 2024Translation Equivariant Transformer Neural Processes18 Jun 2024
- 2024Noise-Aware Differentially Private Regression via Meta-Learning12 Jun 2024
- 2024R'enyi Neural Processes25 May 2024
1 more
- 2024Spectral Convolutional Conditional Neural Processes19 Apr 2024
- 2024Amortized Probabilistic Conditioning for Optimization, Simulation and Inferencecited by 23
- 2024Amortized Bayesian Experimental Design for Decision-Makingcited by 21
- 2024Translation Equivariant Transformer Neural Processescited by 13
- 2024Approximately Equivariant Neural Processescited by 8
- 2025PABBO: Preferential Amortized Black-Box Optimizationcited by 8
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisitioncited by 8
- 2024Spectral Convolutional Conditional Neural Processescited by 4
- 2025Meta-Statistical Learning: Supervised Learning of Statistical Estimatorscited by 3
- 2024Noise-Aware Differentially Private Regression via Meta-Learningcited by 2
- 2024R'enyi Neural Processescited by 1
- 2025MIST: Mutual Information Estimation Via Supervised Trainingcited by 1
- 2026From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Revisiting Neural Processes via Fourier Transform and Volterra Series31 May 2026
- 2026From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimation7 May 2026
- 2025MIST: Mutual Information Estimation Via Supervised Training24 Nov 2025
- 2025ALINE: Joint Amortization for Bayesian Inference and Active Data Acquisition8 Jun 2025
- 2025PABBO: Preferential Amortized Black-Box Optimization2 Mar 2025
- 2025Meta-Statistical Learning: Supervised Learning of Statistical Estimators17 Feb 2025
- 2024Amortized Bayesian Experimental Design for Decision-Making4 Nov 2024
- 2024Amortized Probabilistic Conditioning for Optimization, Simulation and Inference20 Oct 2024
- 2024Approximately Equivariant Neural Processes19 Jun 2024
- 2024Translation Equivariant Transformer Neural Processes18 Jun 2024
- 2024Noise-Aware Differentially Private Regression via Meta-Learning12 Jun 2024
- 2024R'enyi Neural Processes25 May 2024
12 newest of 13 All 13 (JSON)