mlsanityData to 7 Oct 2026

Insights on Galaxy Evolution from Interpretable Sparse Feature Networks

arXiv 2501.00089 ↗First posted 30 Dec 2024astro-ph.GA cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Galaxy appearances reveal the physics of how they formed and evolved. Machine learning models can now exploit galaxies' information-rich morphologies to predict physical properties directly from image cutouts. Learning the relationship between pixel-level features and galaxy properties is essential for building a physical understanding of galaxy evolution, but we are still unable to explicate the details of how deep neural networks represent image features. To address this lack of interpretability, we present a novel neural network architecture called a Sparse Feature Network (SFNet). SFNets produce interpretable features that can be linearly combined in order to estimate galaxy properties like optical emission line ratios or gas-phase metallicity. We find that SFNets do not sacrifice accuracy in order to gain interpretability, and that they perform comparably well to cutting-edge models on astronomical machine learning tasks. Our novel approach is valuable for finding physical patterns in large datasets and helping astronomers interpret machine learning results.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 55 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

13 of 55 references.

References · 13

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  4. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  5. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  6. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  7. 2013k-Sparse Autoencoderscited by 209
  8. 2020fastai: A Layered API for Deep Learningcited by 183
  9. 2024The Missing Curve Detectors of InceptionV1: Applying Sparse Autoencoders to InceptionV1 Early Visioncited by 37
  10. 2021Ranger21: a synergistic deep learning optimizercited by 21
  11. 2020Attention-gating for improved radio galaxy classificationcited by 9
  12. 2024Galaxy spectroscopy without spectra: Galaxy properties from photometric images with conditional diffusion modelscited by 2
1 more
  1. 2020CMasher: Scientific colormaps for making accessible, informative and 'cmashing' plotscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.