mlsanityData to 14 Oct 2026

Relational Response Fields: A General Theory of Black-Box LLM Response Consistency and Recovery

arXiv 2608.04552 ↗First posted 5 Aug 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Black-box language-model reliability is commonly pursued by sampling, prompting, voting, verifying, or iteratively revising individual answers. We ask a prior question: what determines whether a collection of black-box responses is recoverable at all? We represent responses to typed transformations of a query as a relational response field (RRF). Edge transports encode how valid responses must change under paraphrase, scaling, decomposition, refactoring, or other task symmetries; anchors encode independently trusted evidence such as execution or a verifier. For relation operator D, anchor operator A, and at most k corrupted response nodes, we identify γk(D,A) as the intrinsic difficulty of black-box response recovery. It is positive exactly when every k-node corruption is identifiable; it gives a deterministic stability bound proportional to 1/γk; and a matching two-point minimax lower bound shows that no estimator can improve this dependence. Thus consistency is not truth: relation-only methods are blind to null directions, including shared hallucinations. We derive sparse field-repair algorithms while separating information-theoretic identifiability from the stronger null-space conditions required by convex optimization. Controlled theorem tests and black-box mathematics/code experiments evaluate four theory-fixed consequences: consistency--truth separation, anchor phase transitions, redundancy saturation, and cross-model, cross-task prediction of repair difficulty. The results support γk(D,A) as a measurable property of a response-recovery instance, rather than a score attached to one repair heuristic.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 58 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

8 of 58 references.

References · 8

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2023Let's Verify Step by Stepcited by 3,789
  5. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  6. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  7. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
  8. 2020Metamorphic Testing: A New Approach for Generating Next Test Casescited by 75

Built on by

Not cited yet.