Do-Undo Bench: Reversibility for Action Understanding in Image Generation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
We introduce the Do-Undo task and benchmark to address a critical gap in vision-language models: understanding and generating plausible scene transformations driven by real-world actions. Unlike prior work that relies on prompt-based image generation and editing to perform action-conditioned image manipulation, our training hypothesis requires models to simulate the outcome of a real-world action and then reverse it to the original state. This forward-reverse requirement tests genuine cause-and-effect understanding rather than stylistic or semantic edits. We curate a high-quality benchmark of reversible actions from real-world scenarios to enable robust action grounding. Our experiments reveal that current models struggle with action reversibility, highlighting the need to evaluate action understanding. Do-Undo provides an intuitive testbed for evaluating and advancing action-aware generation in multimodal systems that must reason about real-world dynamics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 33 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
28 of 33 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
16 more
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2022Learning Video Representations from Large Language Modelscited by 205
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2023Synthetic Experience Replaycited by 101
- 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
- 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 40
- 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
- 2024UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scalingcited by 31
- 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 16
- 2025Visual Jenga: Discovering Object Dependencies via Counterfactual Inpaintingcited by 11
- 2024Action-based image editing guided by human instructionscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models
- 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalance
- 2026Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning
- 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models
- 2026Beyond Appearance Shifts: Task-Semantic Action Calibration for VLA Models
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge