Software Engineering Agents for Embodied Controller Generation : A Study in Minigrid Environments
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Software Engineering Agents (SWE-Agents) have proven effective for traditional software engineering tasks with accessible codebases, but their performance for embodied tasks requiring well-designed information discovery remains unexplored. We present the first extended evaluation of SWE-Agents on controller generation for embodied tasks, adapting Mini-SWE-Agent (MSWEA) to solve 20 diverse embodied tasks from the Minigrid environment. Our experiments compare agent performance across different information access conditions: with and without environment source code access, and with varying capabilities for interactive exploration. We quantify how different information access levels affect SWE-Agent performance for embodied tasks and analyze the relative importance of static code analysis versus dynamic exploration for task solving. This work establishes controller generation for embodied tasks as a crucial evaluation domain for SWE-Agents and provides baseline results for future research in efficient reasoning systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 26 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
14 of 26 references.
References · 14
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 320
- 2021Benchmarking the Spectrum of Agent Capabilitiescited by 193
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
2 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SWE-Master: Unleashing the Potential of Software Engineering Agents via Post-Training
- 2026SWE-Skills-Bench: Do Agent Skills Actually Help in Real-World Software Engineering?
- 2025TOM-SWE: User Mental Modeling For Software Engineering Agents
- 2026Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills
- 2026SWE-INTERACT: Reimagining SWE Benchmarks as User-Driven Long-Horizon Coding Sessions
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
- 2026SWE-World: Building Software Engineering Agents in Docker-Free Environments
- 2025Training Versatile Coding Agents in Synthetic Environments