mlsanityData to 7 Oct 2026

PhysAgent: Reflective Agentic Physics Control for Physically Plausible Video Generation

arXiv 2607.16355 ↗First posted 17 Jul 2026cs.CV cs.AIcited by 2

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Recent advances in physics-grounded video generation leverage physics simulation as a physical prior to guide video synthesis toward physically plausible outcomes. The simulation process is controlled by physical specifications, which are typically generated by a vision-language model in a single pass. Such one-shot prediction often fails to accurately translate user intent into executable simulations, particularly for fine-grained object dynamics, complex motion trajectories, and temporally structured interactions. In this paper, we propose PhysAgent, a reflective agentic framework that closes the loop among physical program generation, physics simulation, stage-specific verification, and targeted program repair. Beyond improving the control of coupled physical parameters, our framework enables the agent to progressively realize complex trajectories, multi-stage interactions, and precise event outcomes by treating each physical program as an executable hypothesis. In addition, we design a set of physics-control APIs to support more stable and complex motion behaviors. Extensive experiments demonstrate that PhysAgent produces more physically plausible videos, achieves better prompt alignment, and generalizes more effectively across diverse physical scenarios.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 22 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

20 of 22 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoning16 Jan
  2. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar

Other references · 18

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  5. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  9. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  10. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  11. 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
  12. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
6 more
  1. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 65
  2. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
  3. 2025BlenderGym: Benchmarking Foundational Model Systems for Graphics Editingcited by 27
  4. 2026RealWonder: Real-Time Physical Action-Conditioned Video Generationcited by 18
  5. 2026Goal Force: Teaching Video Models To Accomplish Physics-Conditioned Goalscited by 9
  6. 2026PhysVid: Physics Aware Local Conditioning for Generative Video Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026NEWTON: Agentic Planning for Physically Grounded Video Generation
  2. 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization
  3. 2026PhysAgent: Automating Physics-Based 4D Synthesis via Trajectory-Grounded Multi-Agent Feedback
  4. 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning
  5. 2025PhysicalAgent: Towards General Cognitive Robotics with Foundation World Models
  6. 2026Perceptual Self-Reflection in Agentic Physics Simulation Code Generation
  7. 2025MoReGen: Multi-Agent Motion-Reasoning Engine for Code-based Text-to-Video Synthesis
  8. 2024VideoAgent: Self-Improving Video Generation