# Exploring ReAct Prompting for Task-Oriented Dialogue: Insights and Shortcomings

arXiv: https://arxiv.org/abs/2412.01262 · HTML: https://mlsanity.com/paper/2412.01262/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 22 references that are in the map.
- First posted on arXiv 2 Dec 2024.

## Builds on (most cited first, 13 of 13)

- [Training language models to follow instructions with human feedback](https://mlsanity.com/paper/2203.02155/) (2022)
- [Proximal Policy Optimization Algorithms](https://mlsanity.com/paper/1707.06347/) (2017)
- [ReAct: Synergizing Reasoning and Acting in Language Models](https://mlsanity.com/paper/2210.03629/) (2022)
- [MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modelling](https://mlsanity.com/paper/1810.00278/) (2018)
- [Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Dataset](https://mlsanity.com/paper/1909.05855/) (2019)
- [A Network-based End-to-End Trainable Task-oriented Dialogue System](https://mlsanity.com/paper/1604.04562/) (2016)
- [MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems](https://mlsanity.com/paper/2009.12005/) (2020)
- [ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format](https://mlsanity.com/paper/2211.17148/) (2022)
- [Is Your Goal-Oriented Dialog Model Performing Really Well? Empirical Analysis of System-wise Evaluation](https://mlsanity.com/paper/2005.07362/) (2020)
- [Sample Efficient Deep Reinforcement Learning for Dialogue Systems with Large Action Spaces](https://mlsanity.com/paper/1802.03753/) (2018)
- [A Benchmarking Environment for Reinforcement Learning Based Task Oriented Dialogue Management](https://mlsanity.com/paper/1711.11023/) (2017)
- [Diluted Near-Optimal Expert Demonstrations for Guiding Dialogue Stochastic Policy Optimisation](https://mlsanity.com/paper/2012.04687/) (2020)
- [Graph Neural Network Policies and Imitation Learning for Multi-Domain Task-Oriented Dialogues](https://mlsanity.com/paper/2210.05252/) (2022)

## Built on by (most cited first, 3 of 3)

- [Neural Models and Language Model Prompting for the Multidimensional Evaluation of Open-Ended Conversations](https://mlsanity.com/paper/2509.00841/) (2025)
- [ReacTOD: Bounded Neuro-Symbolic Agentic NLU for Zero-Shot Dialogue State Tracking](https://mlsanity.com/paper/2605.19077/) (2026)
- [Prompt reinforcing for long-term planning of large language models](https://mlsanity.com/paper/2510.05921/) (2025)

## Abstract (arXiv)

Large language models (LLMs) gained immense popularity due to their impressive capabilities in unstructured conversations. Empowering LLMs with advanced prompting strategies such as reasoning and acting (ReAct) (Yao et al., 2022) has shown promise in solving complex tasks traditionally requiring reinforcement learning. In this work, we apply the ReAct strategy to guide LLMs performing task-oriented dialogue (TOD). We evaluate ReAct-based LLMs (ReAct-LLMs) both in simulation and with real users. While ReAct-LLMs severely underperform state-of-the-art approaches on success rate in simulation, this difference becomes less pronounced in human evaluation. Moreover, compared to the baseline, humans report higher subjective satisfaction with ReAct-LLM despite its lower success rate, most likely thanks to its natural and confidently phrased responses.