mlsanityData to 13 Oct 2026

Embedding interpretable ℓ1-regression into neural networks for uncovering temporal structure in cell imaging

arXiv 2603.02899 ↗First posted 3 Mar 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

While artificial neural networks excel in unsupervised learning of non-sparse structure, classical statistical regression techniques offer better interpretability, in particular when sparseness is enforced by ℓ1 regularization, enabling identification of which factors drive observed dynamics. We investigate how these two types of approaches can be optimally combined, exemplarily considering two-photon calcium imaging data where sparse autoregressive dynamics are to be extracted. We propose embedding a vector autoregressive (VAR) model as an interpretable regression technique into a convolutional autoencoder, which provides dimension reduction for tractable temporal modeling. A skip connection separately addresses non-sparse static spatial information, selectively channeling sparse structure into the ℓ1-regularized VAR. ℓ1-estimation of regression parameters is enabled by differentiating through the piecewise linear solution path. This is contrasted with approaches where the autoencoder does not adapt to the VAR model. Having an embedded statistical model also enables a testing approach for comparing temporal sequences from the same observational unit. Additionally, contribution maps visualize which spatial regions drive the learned dynamics.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 19 of its 46 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

19 of 46 references.

References · 19

  1. 2018Neural Ordinary Differential Equationscited by 3,750
  2. 2021Convex optimizationcited by 2,488
  3. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,316
  4. 2017Visualizing the Loss Landscape of Neural Netscited by 1,129
  5. 2015Automatic differentiation in machine learning: a surveycited by 852
  6. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 822
  7. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 812
  8. 2014The Loss Surfaces of Multilayer Networkscited by 280
  9. 2015Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Imagescited by 270
  10. 2016Structured Inference Networks for Nonlinear State Space Modelscited by 182
  11. 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 171
  12. 2020Model-Based Deep Learningcited by 139
7 more
  1. 2018Gaussian Process Prior Variational Autoencoderscited by 72
  2. 2021Nonsmooth Implicit Differentiation for Machine Learning and Optimizationcited by 43
  3. 2024The Elements of Differentiable Programmingcited by 42
  4. 2020Implicit differentiation of Lasso-type models for hyperparameter optimizationcited by 34
  5. 2020Longitudinal Variational Autoencodercited by 25
  6. 2022ICE-NODE: Integration of Clinical Embeddings with Neural Ordinary Differential Equationscited by 5
  7. 2016A Differentiable Alternative to the Lasso Penaltycited by 1

Built on by

Not cited yet.