Relational Response Fields: A General Theory of Black-Box LLM Response Consistency and Recovery
Not on the map. Why?
Abstract (arXiv)
Black-box language-model reliability is commonly pursued by sampling, prompting, voting, verifying, or iteratively revising individual answers. We ask a prior question: what determines whether a collection of black-box responses is recoverable at all? We represent responses to typed transformations of a query as a relational response field (RRF). Edge transports encode how valid responses must change under paraphrase, scaling, decomposition, refactoring, or other task symmetries; anchors encode independently trusted evidence such as execution or a verifier. For relation operator D, anchor operator A, and at most k corrupted response nodes, we identify γk(D,A) as the intrinsic difficulty of black-box response recovery. It is positive exactly when every k-node corruption is identifiable; it gives a deterministic stability bound proportional to 1/γk; and a matching two-point minimax lower bound shows that no estimator can improve this dependence. Thus consistency is not truth: relation-only methods are blind to null directions, including shared hallucinations. We derive sparse field-repair algorithms while separating information-theoretic identifiability from the stronger null-space conditions required by convex optimization. Controlled theorem tests and black-box mathematics/code experiments evaluate four theory-fixed consequences: consistency--truth separation, anchor phase transitions, redundancy saturation, and cross-model, cross-task prediction of repair difficulty. The results support γk(D,A) as a measurable property of a response-recovery instance, rather than a score attached to one repair heuristic.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 58 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
8 of 58 references.
References · 8
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
- 2020Metamorphic Testing: A New Approach for Generating Next Test Casescited by 75
Built on by
Not cited yet.