Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
Not on the map. Why?
Abstract (arXiv)
Prior work on trustworthy AI emphasizes model-internal properties such as bias mitigation, adversarial robustness, and interpretability. As AI systems evolve into autonomous agents deployed in open environments and increasingly connected to payments or assets, the operational meaning of trust shifts to end-to-end outcomes: whether an agent completes tasks, follows user intent, and avoids failures that cause material or psychological harm. These risks are fundamentally product-level and cannot be eliminated by technical safeguards alone because agent behavior is inherently stochastic. To address this gap between model-level reliability and user-facing assurance, we propose a complementary framework based on risk management. Drawing inspiration from financial underwriting, we introduce the Agentic Risk Standard (ARS), a payment settlement standard for AI-mediated transactions. ARS integrates risk assessment, underwriting, and compensation into a single transaction framework that protects users when interacting with agents. Under ARS, users receive predefined and contractually enforceable compensation in cases of execution failure, misalignment, or unintended outcomes. This shifts trust from an implicit expectation about model behavior to an explicit, measurable, and enforceable product guarantee. We also present a simulation study analyzing the social benefits of applying ARS to agentic transactions. ARS's implementation can be found at https://github.com/t54-labs/AgenticRiskStandard.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 58 of its 81 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
58 of 81 references.
References · 58
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
38 more
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 605
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 422
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2025Memory in the Age of AI Agentscited by 303
- 2023Shadow Alignment: The Ease of Subverting Safely-Aligned Language Modelscited by 297
- 2023Certifying LLM Safety against Adversarial Promptingcited by 266
- 2021Trustworthy AI: From Principles to Practicescited by 207
- 2024Transcoders Find Interpretable LLM Feature Circuitscited by 200
- 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 188
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
- 2023MART: Improving LLM Safety with Multi-round Automatic Red-Teamingcited by 163
- 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
- 2025Memory OS of AI Agentcited by 150
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 111
- 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 98
- 2024LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution Shiftscited by 86
- 2023ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agentcited by 81
- 2025A Survey of AI Agent Protocolscited by 81
- 2024Large Language Model Agent in Financial Trading: A Surveycited by 60
- 2024Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perceptioncited by 56
- 2025AutoAgent: A Fully-Automated and Zero-Code Framework for LLM Agentscited by 52
- 2024Towards Implicit Bias Detection and Mitigation in Multi-Agent LLM Interactionscited by 51
- 2025LLMs for Explainable AI: A Comprehensive Surveycited by 45
- 2023Towards LLM-guided Causal Explainability for Black-box Text Classifierscited by 44
- 2023Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactualscited by 44
- 2024ComposerX: Multi-Agent Symbolic Music Composition with LLMscited by 42
- 2025A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directionscited by 34
- 2024Decoding Biases: Automated Methods and LLM Judges for Gender Bias Detection in Language Modelscited by 33
- 2024MobileFlow: A Multimodal LLM For Mobile GUI Agentcited by 32
- 2025MCP-AgentBench: Evaluating Real-World Language Agent Performance with MCP-Mediated Toolscited by 32
- 2024EPO: Hierarchical LLM Agents with Environment Preference Optimizationcited by 28
- 2025SlideGen: Collaborative Multimodal Agents for Scientific Slide Generationcited by 25
- 2023MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Modelscited by 20
- 2023Enhancing Trust in LLM-Based AI Automation Agents: New Considerations and Future Challengescited by 19
- 2024Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoningcited by 16
- 2025When Agents Trade: Live Multi-Market Trading Benchmark for LLM Agentscited by 16
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Auditing Agent Harness Safetycited by 11
- 2026Insuring Every Action: An Authority Frontier Framework for Runtime Actuarial Control of Autonomous AI Agentscited by 4
- 2026Foundations of a Time-Consistent Counterfactual Actuarial Runtime for Autonomous AI Agentscited by 3
- 2026RAILS: Verification-Native Clearing For Agentic Commercecited by 3
- 2026When Agent Automation Becomes Profitable: Quantifying and Insuring Autonomous AI Risk through Trace-Economic Underwritingcited by 3
- 2026Gaming-Resistant Insurance Contracts for Autonomous AI Agents: Strategy-Proof Toll Mechanism Designcited by 0
- 2026The Irreversibility Budget: Fleet-Level Risk Accounting and Admission Control for Agent Operating Systemscited by 0
- 2026Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systemscited by 0
- 2026Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems30 Sep 2026
- 2026The Irreversibility Budget: Fleet-Level Risk Accounting and Admission Control for Agent Operating Systems31 Aug 2026
- 2026When Agent Automation Becomes Profitable: Quantifying and Insuring Autonomous AI Risk through Trace-Economic Underwriting15 Jun 2026
- 2026Gaming-Resistant Insurance Contracts for Autonomous AI Agents: Strategy-Proof Toll Mechanism Design15 Jun 2026
- 2026RAILS: Verification-Native Clearing For Agentic Commerce7 Jun 2026
- 2026Foundations of a Time-Consistent Counterfactual Actuarial Runtime for Autonomous AI Agents26 May 2026
- 2026Insuring Every Action: An Authority Frontier Framework for Runtime Actuarial Control of Autonomous AI Agents25 May 2026
- 2026Auditing Agent Harness Safety14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security
- 2026Beyond Benchmark Islands: Toward Representative Trustworthiness Evaluation for Agentic AI
- 2026TessPay: Verify-then-Pay Infrastructure for Trusted Agentic Commerce
- 2022Measuring an artificial intelligence agent's trust in humans using machine incentives
- 2026Trust Between AI Agents: Measuring Formation, Breakage, and Recovery, with Implications for Governing Multi-Agent Systems
- 2026A Policy Algebra for Trust-Preserving Agentic AI Execution
- 2026Replayable Financial Agents: A Determinism-Faithfulness Assurance Harness for Tool-Using LLM Agents
- 2025The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets