mlsanityData to 14 Oct 2026

When Do Language-Grounded Explanations Help? A Graph-Bottleneck for Farm Monitoring Interpretable Sheep Facial Pain

arXiv 2609.20427 ↗First posted 17 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated pain recognition from facial expression could make continuous welfare assessment practical in sheep, but adoption depends on trust: a stockperson cannot act on a score that arrives without justification. We ground a model in the Sheep Pain Facial Expression Scale (SPFES) by letting each detected facial region attend over text embeddings of the clinical descriptors and then test whether the resulting explanations mean anything. They do not. Ablating an entire descriptor changes the predicted logit by about 10-4, and the most-attended cue agrees with the predicted pain level in only 32.6% of regions, although the attention maps, the learned gate, and the generated text all proposed otherwise. We therefore remove the appearance bypass with a concept bottleneck whose classifier reads only SPFES concept scores, supervised by per-region state annotations that image-level pipelines discard. This costs 0.05--0.10 in Cohen's kappa but yields concepts that are demonstrably learned: minority pain-indicating states are recovered at 3.5--8.3× their base rates, and the ear and eye severity orderings emerge without severity supervision. Removing the supervision alone leaves kappa unchanged while concept accuracy falls to 0.109, showing that architectural necessity does not imply semantic validity. We also show that pooled concept accuracy is misleading under clinical imbalance and provide a cross-validated, protocol-matched benchmark of seven methods on this dataset.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

11 of 26 references.

References · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2020Concept Bottleneck Modelscited by 1,032
  5. 2019Attention is not Explanationcited by 929
  6. 2018Learning Human-Object Interactions by Graph Parsing Neural Networkscited by 176
  7. 2021Do Concept Bottleneck Models Learn as Intended?cited by 116
  8. 2019Stability and Generalization of Graph Convolutional Neural Networkscited by 81
  9. 2015Human and Sheep Facial Landmarks Localisation by Triplet Interpolated Featurescited by 9
  10. 2024Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalizationcited by 6
  11. 2025Sheep Facial Pain Assessment Under Weighted Graph Neural Networkscited by 2

Built on by

Not cited yet.