TRUST: A Decentralized Framework for Auditing Large Language Model Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large Language Models generate complex reasoning chains that reveal their decision-making, yet verifying the faithfulness and harmlessness of these intermediate steps remains a critical unsolved problem. Existing auditing methods are centralized, opaque, and hard to scale, creating significant risks for deploying proprietary models in high-stakes domains. We identify four core challenges: (1) Robustness: Centralized auditors are single points of failure, prone to bias or attacks. (2) Scalability: Reasoning traces are too long for manual verification. (3) Opacity: Closed auditing undermines public trust. (4) Privacy: Exposing full reasoning risks model theft or distillation. We propose TRUST, a transparent, decentralized auditing framework that overcomes these limitations via: (1) A consensus mechanism among diverse auditors, guaranteeing correctness under up to 30% malicious participants. (2) A hierarchical DAG decomposition of reasoning traces, enabling scalable, parallel auditing. (3) A blockchain ledger that records all verification decisions for public accountability. (4) Privacy-preserving segmentation, sharing only partial reasoning steps to protect proprietary logic. We provide theoretical guarantees for the security and economic incentives of the TRUST framework. Experiments across multiple LLMs (GPT-OSS, DeepSeek-r1, Qwen) and reasoning tasks (math, medical, science, humanities) show TRUST effectively detects reasoning flaws and remains robust against adversarial auditors. Our work pioneers decentralized AI auditing, offering a practical path toward safe and trustworthy LLM deployment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 33 of its 74 references that are in the map. First posted on arXiv 23 Oct 2025.
Builds on
33 of 74 references.
Closest ancestors · 1
Same direction, newest first
- 2024OpenAI o1 System Card21 Dec
Other references · 32
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 760
20 more
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2022Towards Reasoning in Large Language Models: A Surveycited by 593
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2025Reasoning Models Don't Always Say What They Thinkcited by 388
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2021LexGLUE: A Benchmark Dataset for Legal Language Understanding in Englishcited by 302
- 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 201
- 2025Process Reward Models That Thinkcited by 118
- 2022Holistic Evaluation of Language Modelscited by 115
- 2025NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Modelcited by 94
- 2023FinGPT: Instruction Tuning Benchmark for Open-Source Large Language Models in Financial Datasetscited by 68
- 2023The Foundation Model Transparency Indexcited by 63
- 2024A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chainscited by 63
- 2025Deconstructing Long Chain-of-Thought: A Structured Reasoning Optimization Framework for Long CoT Distillationcited by 39
- 2025Are You Getting What You Pay For? Auditing Model Substitution in LLM APIscited by 35
- 2025A Survey of Zero-Knowledge Proof Based Verifiable Machine Learningcited by 21
- 2024Verifiable evaluations of machine learning models using zkSNARKscited by 14
- 2025CoIn: Counting the Invisible Reasoning Tokens in Commercial Opaque LLM APIscited by 14
- 2025Attestable Audits: Verifiable AI Safety Benchmarks Using Trusted Execution Environmentscited by 8
- 2025CoT-ICL Lab: A Synthetic Framework for Studying Chain-of-Thought Learning from In-Context Demonstrationscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TRUST: A Framework for Decentralized AI Service v.0.1
- 2026Zer0n: An AI-Assisted Vulnerability Discovery and Blockchain-Backed Integrity Framework
- 2026IMMACULATE: A Practical LLM Auditing Framework via Verifiable Computation
- 2025Policy Frameworks for Transparent Chain-of-Thought Reasoning in Large Language Models
- 2026Agentic Witnessing: Pragmatic and Scalable TEE-Enabled Privacy-Preserving Auditing
- 2025A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
- 2026RAudit: A Blind Auditing Protocol for Large Language Model Reasoning
- 2026An Effective and Cost-Efficient Agentic Framework for Ethereum Smart Contract Auditing