mlsanityData to 14 Oct 2026

GroundAct: Can LLM Agents Ground Actions in Environmental States?

arXiv 2508.05614 ↗First posted 7 Aug 2025cs.CL cs.AIcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

LLM agents achieve 85-96% success on tasks where instructions fully specify the action, but drop to 29-53% when action feasibility depends on environmental state that the instruction does not mention. We argue that this gap reflects a missing capability: action grounding, the ability to infer from structured environmental state whether an action is feasible, what prerequisites it lacks, and whether it exceeds individual capacity. We introduce GroundAct, a benchmark of 1,500 scenarios and 16,592 task instances in text-based interactive environments spanning 11 domains, with tasks organized into seven categories along a cognitive complexity hierarchy. Evaluating 15 LLMs (3B-671B), we find three diagnostic patterns: (i) attribute reasoning is weakly correlated with tool and coordination reasoning, producing distinct model profiles; (ii) complete environment graphs yield up to +27.6/-22.9% on tool use vs. implicit collaboration, separating search-bound from constraint-filtering bottlenecks; and (iii) supervised fine-tuning lifts Qwen2.5-3B from 0.6% to 76.3% on direct command but only 1.5% to 5.5% on implicit collaboration. These results establish action grounding as a multi-dimensional challenge irreducible to scaling.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 14 of its 25 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

14 of 25 references.

References · 14

  1. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  2. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  3. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
  4. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  5. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  6. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  7. 2024DataComp-LM: In search of the next generation of training sets for language modelscited by 398
  8. 2018TextWorld: A Learning Environment for Text-based Gamescited by 310
  9. 2018Machine Theory of Mindcited by 226
  10. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 221
  11. 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 144
  12. 2025ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Modelscited by 118
2 more
  1. 2024PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Taskscited by 82
  2. 2018Counting to Explore and Generalize in Text-based Gamescited by 36

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026What Do LLM Agents Know About Their World? Task2Quiz: A Paradigm for Studying Environment Understanding
  2. 2026AgentEscapeBench: Evaluating Out-of-Domain Tool-Grounded Reasoning in LLM Agents
  3. 2026AgentAbstain: Do LLM Agents Know When Not to Act?
  4. 2026MAP: A Map-then-Act Paradigm for Long-Horizon Interactive Agent Reasoning
  5. 2025Beyond Reactivity: Measuring Proactive Problem Solving in LLM Agents
  6. 2026From Task Solving to Robust Real-World Adaptation in LLM Agents
  7. 2026Demystifying Agent Skills: Why They Work-Until They Don't
  8. 2026Schema: Discovering Unknown Environments via Agentic Program Induction