mlsanityData to 14 Oct 2026

Signed Evidence Flow: Conflict-Aware and Stability-Calibrated Data Analysis

arXiv 2606.21875 ↗First posted 20 Jun 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern data analysis usually gives a prediction without showing whether the evidence behind it is clear, conflicting, or stable. Two cases can have the same fitted confidence even when one has mostly agreeing evidence and the other has strong support and strong opposition. We propose Signed Evidence Flow (SEF), which combines a fitted prediction rule with signed feature attributions to measure support, opposition, conflict, and perturbation stability. We prove that confidence determines conflict exactly when it also determines total evidence mass, derive the remaining conditional variance, and state when conflict can improve loss prediction beyond confidence and other audit variables. We also connect conflict to geometric decision fragility. Across healthcare, Covertype, black-box, finance, and ten external data sets, conflict sometimes separates risk among predictions that already appear confident. Cross-fitted tests show added error-ranking information beyond confidence and attribution entropy on several data sets, including two large finance tasks. The direction is not universal: in some tasks, lowconflict cases are riskier. We therefore introduce ScopeGate, a held-out permutation diagnostic that checks the direction before SEF is used for review triage. SEF is consequently an audit tool rather than a universal risk score: it describes evidence structure, while an independent calibration sample determines whether that structure is useful in the target population.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 20 Jun 2026.

Builds on

15 of 25 references.

References · 15

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  2. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  3. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  4. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  5. 2017Selective Classification for Deep Neural Networkscited by 852
  6. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
  7. 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 373
  8. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  9. 2019Interpretable machine learning: definitions, methods, and applicationscited by 305
  10. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
  11. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 213
  12. 2026ToolChain-CRC: Conformal Risk Control for Agentic AI Under Retrieval and Tool-Use Driftcited by 6
3 more
  1. 2026Drift-Aware Spectral Conformal Prediction for Non-Exchangeable Streaming Datacited by 2
  2. 2026PromptShift-CRC: Drift-Aware Conformal Risk Control for Foundation Models Under Prompt and Domain Shiftcited by 2
  3. 2026Spectral Adaptive Conformal Prediction for Structured Non-Exchangeable Datacited by 1

Built on by

Not cited yet.