Decision Oriented Technique (DOTechnique): Finding Model Validity Through Decision-Maker Context
Not on the map. Why?
Abstract (arXiv)
Model validity is as critical as the model itself, especially when guiding decision-making processes. Traditional approaches often rely on predefined validity frames, which may not always be available or sufficient. This paper introduces the Decision Oriented Technique (DOTechnique), a novel method for determining model validity based on decision consistency rather than output similarity. By evaluating whether surrogate models lead to equivalent decisions compared to high-fidelity models, DOTechnique enables efficient identification of validity regions, even in the absence of explicit validity boundaries. The approach integrates domain constraints and symbolic reasoning to narrow the search space, enhancing computational efficiency. A highway lane change system serves as a motivating example, demonstrating how DOTechnique can uncover the validity region of a simulation model. The results highlight the potential of the technique to support finding model validity through decision-maker context.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 0 of its 5 references that are in the map. First posted on arXiv 12 Oct 2025.
Builds on
0 of 5 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DeLLMa: Decision Making Under Uncertainty with Large Language Models
- 2025EconEvals: Benchmarks and Litmus Tests for Economic Decision-Making by LLM Agents
- 2026General Decision Models: Benchmarking and Insights Beyond Jev
- 2024Exploring Critical Testing Scenarios for Decision-Making Policies: An LLM Approach
- 2025When Judgment Becomes Noise: How Design Failures in LLM Judge Benchmarks Silently Undermine Validity
- 2025AIM-Bench: Evaluating Decision-making Biases of Agentic LLM as Inventory Manager
- 2025Rethinking Prospect Theory for LLMs: Revealing the Instability of Decision-Making under Epistemic Uncertainty
- 2025LLM-ABM for Transportation: Assessing the Potential of LLM Agents in System Analysis