Self-Reports Are Not Verification: Environment-Grounded Auditing of LLM Operators in Evolutionary Search
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Language model agents increasingly propose actions, observe external feedback, and explain their own behavior. Their confidence and rationales are convenient monitoring signals, but convenience is not verification. We introduce an environment-grounded audit in which every intermediate proposal receives an exact outcome. A language model operates an evolutionary Contexto search whose feedback function assigns every valid guess an exact rank without human annotation. Across 200 runs spanning five configurations and three model families, four reporting configurations produce 12,249 self-reports. We test three assumptions: stated confidence is calibrated, inherited rationales affect later proposals, and fitness-based selection improves report quality. All three fail. Operators overstate top-100 success by factors of 4.8 to 9.3, while calibration and discrimination dissociate across model families. Controlled interventions on 754 inherited rationales bound any measured benefit of the genuine rationale to roughly 250 ranks. Neither fitness-based nor random selection produces a detectable selection differential or parent-to-offspring transmission in report accuracy, despite sharply different search behavior. Agent self-reports should therefore be treated as claims to verify against the environment, not as evidence of their own reliability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 27 of its 37 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
27 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 26
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2023Large Language Models as Optimizerscited by 830
14 more
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 731
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 590
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2019Verified Uncertainty Calibrationcited by 307
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 253
- 2020Reducing conversational agents' overconfidence through linguistic calibrationcited by 209
- 2022Evolution through Large Modelscited by 131
- 2023Language Model Crossover: Variation through Few-Shot Promptingcited by 119
- 2024On scalable oversight with weak LLMs judging strong LLMscited by 94
- 2025Uncertainty Quantification and Confidence Calibration in Large Language Models: A Surveycited by 93
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Large Language Model Agents Are Not Always Faithful Self-Evolvers
- 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrations
- 2026DarwinX: Evolving Agent Harnesses Through Natural Selection
- 2026SkillHone: A Harness for Continual Agent Skill Evolution Through Persistent Decision History
- 2026Search-E1: Self-Distillation Drives Self-Evolution in Search-Augmented Reasoning
- 2026Evolving Deception: When Agents Evolve, Deception Wins
- 2026SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback
- 2026SelfSearch: Reward-Free Search for Self-Improving Agents