Grounding Large Language Models in DSGE Simulators for Policy Generation and Forecasting
Not on the map. Why?
Abstract (arXiv)
Large language models can produce economic policy responses that sound reasonable, but this does not show that their actions are consistent with economic dynamics. We test this by placing an instruction-tuned language model inside six Snowdrop-backed dynamic stochastic general equilibrium (DSGE) simulators. At each turn, the model observes the economy and a change in economic discourse, selects a bounded policy action, and receives the next simulated state and an economic reward. We implement a common Python interface for repeated rollouts, persistent shocks, state cloning, and rolling-horizon simulation. This setting creates a long-horizon credit-assignment problem. Policy effects may appear several quarters after an action is taken. PPO has a learned value function that can propagate delayed reward to earlier tokens through generalized advantage estimation. GRPO has no learned value function and instead assigns a group-relative advantage from complete rollout returns. It therefore cannot distinguish which earlier turn caused the outcome; if every rollout receives the same return, the normalized advantage is zero. We use PPO as the primary method and GRPO as a matched critic-free baseline. The experiments also test directional semantic signals, reward horizon, trajectory warm starts, cross-simulator transfer, and historically anchored pandemic and monetary-policy shocks. The objective is to judge policy actions by their simulated economic consequences rather than by plausible language alone.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
16 of 25 references.
References · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,194
- 2017Hindsight Experience Replaycited by 1,136
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 195
- 2018RUDDER: Return Decomposition for Delayed Rewardscited by 173
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 86
- 2025Reinforcing Multi-Turn Reasoning in LLM Agents via Fine-Grained Reward Structure and Credit Assignmentcited by 79
- 2018GEP-PG: Decoupling Exploration and Exploitation in Deep Reinforcement Learning Algorithmscited by 40
4 more
- 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMscited by 34
- 2026Your Group-Relative Advantage Is Biasedcited by 34
- 2024Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narrativescited by 13
- 2025Stories that (are) Move(d by) Markets: A Causal Exploration of Market Shocks and Semantic Shifts across Different Partisan Groupscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Think, Speak, Decide: Language-Augmented Multi-Agent Reinforcement Learning for Economic Decision-Making
- 2024Large Legislative Models: Towards Efficient AI Policymaking in Economic Simulations
- 2024GLEE: A Unified Framework and Benchmark for Language-based Economic Environments
- 2025A Multi-LLM-Agent-Based Framework for Economic and Public Policy Analysis
- 2026When Valid Signals Fail: Regime Boundaries Between LLM Features and RL Trading Policies
- 2025Noise, Adaptation, and Strategy: Assessing LLM Fidelity in Decision-Making
- 2025LLM Economist: Large Population Models and Mechanism Design in Multi-Agent Generative Simulacra
- 2026V0: A Generalist Value Model for Any Policy at State Zero