mlsanityData to 14 Oct 2026

Scene Parameter Saliency via Differentiable Light Transport

arXiv 2607.21562 ↗First posted 23 Jul 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Gradient-based saliency methods reveal which input features most influence a neural network's output, and are a standard tool for model interpretability. We observe that differentiable renderers, which are conventionally used for parameter optimisation, produce an analogous form of saliency: given any scalar metric evaluated on a rendered image, a single reverse-mode differentiation pass yields per-parameter gradients that identify which scene elements most influence the metric. We call these gradient fields metric saliency maps. Unlike neural saliency, which propagates attribution through learned weights, metric saliency propagates through the image formation process itself, including multi-bounce light transport, capturing parameter dependencies that are semi-opaque to manual inspection. We compute metric saliency maps for qualitatively different objectives: psychovisual glare indices, mean scene luminance, and neural perceptual scores. The saliency rankings differ substantially across metrics for the same scene, with parameters that dominate one objective being negligible for another. The saliency map is specific to the metric, not an intrinsic property of the scene. Our results suggest that differentiable renderers produce derivative images that are as informative for scene understanding as the primal images they were designed to generate.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

19 of 42 references.

References · 19

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  5. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  7. 2017SmoothGrad: removing noise by adding noisecited by 1,109
  8. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
  9. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  10. 2017Neural 3D Mesh Renderercited by 437
  11. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  12. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
7 more
  1. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
  2. 2022Saliency Cards: A Framework to Characterize and Compare Saliency Methodscited by 11
  3. 2023Diff-DOPE: Differentiable Deep Object Pose Estimationcited by 11
  4. 2024DiffCSG: Differentiable CSG via Rasterizationcited by 7
  5. 2024Stochastic Gradient Estimation for Higher-order Differentiable Renderingcited by 2
  6. 2025MRD: Using Physically Based Differentiable Rendering to Probe Vision Models for 3D Scene Understandingcited by 2
  7. 2023View-Independent Adjoint Light Tracing for Lighting Design Optimizationcited by 1

Built on by

Not cited yet.