mlsanityData to 14 Oct 2026

Breaking the Central Bias: Spatially Partitioned Experts for Coordinate-Based Neuroevolution

arXiv 2609.11518 ↗First posted 10 Sep 2026cs.NE cs.CV cs.LGcited by 0

On the map: Mixture-of-experts → MoE theory and gating functions

Abstract (arXiv)

Evolvable-Substrate HyperNEAT (ES-HyperNEAT), a bio-inspired indirect encoding that determines neuron placement and connection weights from spatial coordinates, exhibits a failure mode on MNIST as a diagnostic benchmark. Because input pixels map to a coordinate space centered at the origin, evolved networks converge on a small central cluster of input pixels, a spatial-concentration bias; prior work observed only 21% mean accuracy in this regime. Is this bias an optimization artifact or an architectural ceiling? Inspired by Mixture-of-Experts (MoE) principles, we partition the input into non-overlapping spatial segments, each assigned to a separately evolved specialist network. With 13 such experts, this design reaches 43% mean accuracy, a 106% relative improvement over the baseline. The architectural gain does not depend on data-driven aggregation: equal-weighted averaging, which uses no validation data, already yields a 70% improvement; the gain comes from partitioning, not the weighting. Receptive-field analysis shows the mechanism: partitioning forces evolution to discover features across the entire image, expanding active pixel coverage from 4% to 79%. Absolute accuracy stays below gradient-trained baselines, but the relative gain points to central bias, not the evolutionary search. Two tools are designed to generalize beyond MNIST: a receptive-field diagnostic for silent input-coverage collapse, and a spatial-partitioning remedy that restores coverage.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MoE theory and gating functions, one of 12 directions in Mixture-of-experts. Builds on 2 of its 17 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

2 of 17 references.

References · 2

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  2. 2026Investigating Hyperparameter Optimization and Transferability for ES-HyperNEAT: A TPE Approachcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025NeuroVolve: Evolving Visual Stimuli toward Programmable Neural Objectives
  2. 2026Agentic Discovery with Active Hypothesis Exploration for Visual Recognition
  3. 2025MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding
  4. 2025Representational Alignment Across Model Layers and Brain Regions with Multi-Level Optimal Transport
  5. 2026NeurIPS: Neuro-anatomical Inductive Priors for Sphere-based Brain Decoding
  6. 2025Mixture of Neuron Experts
  7. 2026Emergent Specialization in Populations of Self-Supervised Collaborative Vision Experts Without a Shared Gate or Cross-Agent Gradients
  8. 2024Decomposing the Neurons: Activation Sparsity via Mixture of Experts for Continual Test Time Adaptation