mlsanityData to 7 Oct 2026

Large Language Models as Visualization Agents for Immersive Binary Reverse Engineering

arXiv 2508.13413 ↗First posted 19 Aug 2025cs.HC cs.SEcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Immersive virtual reality (VR) offers affordances that may reduce cognitive complexity in binary reverse engineering (RE), enabling embodied and external cognition to augment the RE process through enhancing memory, hypothesis testing, and visual organization. In prior work, we applied a cognitive systems engineering approach to identify an initial set of affordances and implemented a VR environment to support RE through spatial persistence and interactivity. In this work, we extend that platform with an integrated large language model (LLM) agent capable of querying binary analysis tools, answering technical questions, and dynamically generating immersive 3D visualizations in alignment with analyst tasks. We describe the system architecture and our evaluation process and results. Our pilot study shows that while LLMs can generate meaningful 3D call graphs (for small programs) that align with design principles, output quality varies widely. This work raises open questions about the potential for LLMs to function as visualization agents, constructing 3D representations that reflect cognitive design principles without explicit training.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 2 of its 14 references that are in the map. First posted on arXiv 19 Aug 2025.

Builds on

2 of 14 references.

References · 2

  1. 2024DracoGPT: Extracting Visualization Design Preferences from Large Language Modelscited by 12
  2. 2024A Cognitive Approach to Improving Binary Reverse Engineering with Immersive Virtual Realitycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Observability Gap: Why Output-Level Human Feedback Fails for LLM Coding Agents
  2. 2025From 2D to 3D Cognition: A Brief Survey of General World Models
  3. 2023See and Think: Embodied Agent in Virtual Environment
  4. 2025Conversational Interfaces for Parametric Conceptual Architectural Design: Integrating Mixed Reality with LLM-driven Interaction
  5. 2025VistaWise: Building Cost-Effective Agent with Cross-Modal Knowledge Graph for Minecraft
  6. 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualization
  7. 2026ExploreAI: Agentic Exploration Knowledge Bases for Reproducible Observable-Regression Testing of Black-Box VR and 3D Applications
  8. 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Code