Evolving Multi-Channel Confidence-Aware Activation Functions for Missing Data with Channel Propagation
Not on the map. Why?
Abstract (arXiv)
Learning in the presence of missing data can result in biased predictions and poor generalizability, among other difficulties, which data imputation methods only partially address. In neural networks, activation functions significantly affect performance yet typical options (e.g., ReLU, Swish) operate only on feature values and do not account for missingness indicators or confidence scores. We propose Three-Channel Evolved Activations (3C-EA), which we evolve using Genetic Programming to produce multivariate activation functions f(x, m, c) in the form of trees that take (i) the feature value x, (ii) a missingness indicator m, and (iii) an imputation confidence score c. To make these activations useful beyond the input layer, we introduce ChannelProp, an algorithm that deterministically propagates missingness and confidence values via linear layers based on weight magnitudes, retaining reliability signals throughout the network. We evaluate 3C-EA and ChannelProp on datasets with natural and injected (MCAR/MAR/MNAR) missingness at multiple rates under identical preprocessing and splits. Results indicate that integrating missingness and confidence inputs into the activation search improves classification performance under missingness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 14 Feb 2026.
Builds on
10 of 34 references.
References · 10
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 425
- 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 352
- 2021Activation Functions in Deep Learning: A Comprehensive Survey and Benchmarkcited by 155
- 2018Handling Incomplete Heterogeneous Data using VAEscited by 149
- 2020A survey on modern trainable activation functionscited by 89
- 2016Modeling Missing Data in Clinical Time Series with RNNscited by 80
- 2024Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networkscited by 23
- 2020Evolutionary Optimization of Deep Learning Activation Functionscited by 18
Built on by
Not cited yet.