mlsanityData to 7 Oct 2026

Localizing Prompt Ambiguity in Large Language Models with Probe-Targeted Attribution

arXiv 2606.05486 ↗First posted 3 Jun 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Prompt ambiguity is a common source of failure in large language models, but is difficult to localize because it is a latent property of the prompt, while existing attribution methods are designed to explain observable outputs such as logits or generated tokens. We introduce PRIG, a gradient attribution method that uses a probe logit to attribute latent ambiguity to token positions. Specifically, PRIG trains a linear probe to distinguish clear prompts from ambiguous prompts and attributes the probe score to earlier token representations in the residual stream. To enable token-level evaluation, we construct synthetic ambiguity datasets across coding, math, and writing by rewriting one task-critical sentence per prompt, and complement them with a human-written gold benchmark. In this setting, PRIG localizes ambiguous spans substantially better than gradient attribution baselines, achieving 0.840 AUROC on the combined synthetic benchmark and 0.891 AUROC on the gold set. It also outperforms GPT-5.4 on sentence-level ambiguity identification and retains useful signal out-of-domain. These results establish PRIG as a practical tool for identifying which parts of a prompt are ambiguous. More broadly, they suggest that latent prompt properties can be localized through intermediate representations, rather than through output-level attribution.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 45 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

33 of 45 references.

References · 33

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  6. 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
  7. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  8. 2019Attention is not Explanationcited by 916
  9. 2020Quantifying Attention Flow in Transformerscited by 759
  10. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  11. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
  12. 2025SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?cited by 254
21 more
  1. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  2. 2021Guided Integrated Gradients: An Adaptive Path Method for Removing Noisecited by 102
  3. 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 100
  4. 2025LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMscited by 67
  5. 2023Selectively Answering Ambiguous Questionscited by 63
  6. 2025No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probescited by 35
  7. 2024AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queriescited by 32
  8. 2025What Prompts Don't Say: Understanding and Managing Underspecification in LLM Promptscited by 32
  9. 2025ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMscited by 31
  10. 2020Understanding Integrated Gradients with SmoothTaylor for Deep Neural Network Attributioncited by 19
  11. 2025TokenShapley: Token Level Context Attribution with Shapley Valuecited by 14
  12. 2019Identifying Unclear Questions in Community Question Answering Websitescited by 12
  13. 2025Disambiguate First, Parse Later: Generating Interpretations for Ambiguity Resolution in Semantic Parsingcited by 12
  14. 2024Scope Ambiguities in Large Language Modelscited by 11
  15. 2025RelP: Faithful and Efficient Circuit Discovery in Language Models via Relevance Patchingcited by 10
  16. 2025Probing Syntax in Large Language Models: Successes and Remaining Challengescited by 4
  17. 2025Sparse Neurons Carry Strong Signals of Question Ambiguity in LLMscited by 4
  18. 2025Generalized Attention Flow: Feature Attribution for Transformer Models via Maximum Flowcited by 3
  19. 2026Explainable AI: Context-Aware Layer-Wise Integrated Gradients for Explaining Transformer Modelscited by 1
  20. 2026Probing for Knowledge Attribution in Large Language Modelscited by 1
  21. 2026GRADE: Probing Knowledge Gaps in LLMs through Gradient Subspace Dynamicscited by 1

Built on by

Not cited yet.