mlsanityData to 7 Oct 2026

Extremal Contours: Gradient-driven contours for compact visual attribution

arXiv 2511.01411 ↗First posted 3 Nov 2025cs.CV cs.LG eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Faithful yet compact explanations for vision models remain a challenge, as commonly used dense perturbation masks are often fragmented and overfitted, needing careful post-processing. Here, we present a training-free explanation method that replaces dense masks with smooth tunable contours. A star-convex region is parameterized by a truncated Fourier series and optimized under an extremal preserve/delete objective using the classifier gradients. The approach guarantees a single, simply connected mask, cuts the number of free parameters by orders of magnitude, and yields stable boundary updates without cleanup. Restricting solutions to low-dimensional, smooth contours makes the method robust to adversarial masking artifacts. On ImageNet classifiers, it matches the extremal fidelity of dense masks while producing compact, interpretable regions with improved run-to-run consistency. Explicit area control also enables importance contour maps, yielding a transparent fidelity-area profiles. Finally, we extend the approach to multi-contour and show how it can localize multiple objects within the same framework. Across benchmarks, the method achieves higher relevance mass and lower complexity than gradient and perturbation based baselines, with especially strong gains on self-supervised DINO models where it improves relevance mass by over 15% and maintains positive faithfulness correlations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 3 Nov 2025.

Builds on

27 of 35 references.

References · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  6. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  7. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  8. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
  9. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  10. 2018Sanity Checks for Saliency Mapscited by 1,149
  11. 2016End to End Learning for Self-Driving Carscited by 1,000
  12. 2014Striving for Simplicity: The All Convolutional Netcited by 983
15 more
  1. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  2. 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
  3. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  4. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 467
  5. 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 342
  6. 2016Top-down Neural Attention by Excitation Backpropcited by 318
  7. 2019Understanding Deep Networks via Extremal Perturbations and Smooth Maskscited by 257
  8. 2020Evaluating and Aggregating Feature-based Model Explanationscited by 185
  9. 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 125
  10. 2020Restricting the Flow: Information Bottlenecks for Attributioncited by 110
  11. 2021RELAX: Representation Learning Explainabilitycited by 12
  12. 2023Fast spline detection in high density microscopy datacited by 3
  13. 2025Spline refinement with differentiable renderingcited by 2
  14. 2024Towards Voronoi Diagrams of Surface Patchescited by 1
  15. 2025Generating visual explanations from deep networks using implicit neural representationscited by 1

Built on by

Not cited yet.