mlsanityData to 14 Oct 2026

Do-Undo Bench: Reversibility for Action Understanding in Image Generation

arXiv 2512.13609 ↗First posted 15 Dec 2025cs.CV cs.LGcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

We introduce the Do-Undo task and benchmark to address a critical gap in vision-language models: understanding and generating plausible scene transformations driven by real-world actions. Unlike prior work that relies on prompt-based image generation and editing to perform action-conditioned image manipulation, our training hypothesis requires models to simulate the outcome of a real-world action and then reverse it to the original state. This forward-reverse requirement tests genuine cause-and-effect understanding rather than stylistic or semantic edits. We curate a high-quality benchmark of reversible actions from real-world scenarios to enable robust action grounding. Our experiments reveal that current models struggle with action reversibility, highlighting the need to evaluate action understanding. Do-Undo provides an intuitive testbed for evaluating and advancing action-aware generation in multimodal systems that must reason about real-world dynamics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 33 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

28 of 33 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  6. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  9. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  10. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  11. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  12. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
16 more
  1. 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 225
  2. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  3. 2022Learning Video Representations from Large Language Modelscited by 205
  4. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  5. 2024Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationcited by 174
  6. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  7. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  8. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  9. 2023Synthetic Experience Replaycited by 101
  10. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  11. 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 40
  12. 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
  13. 2024UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scalingcited by 31
  14. 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 16
  15. 2025Visual Jenga: Discovering Object Dependencies via Counterfactual Inpaintingcited by 11
  16. 2024Action-based image editing guided by human instructionscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models
  2. 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalance
  3. 2026Mitigating State Aliasing in Vision-Language-Action Models via Inverse Dynamics Learning
  4. 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models
  5. 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination
  6. 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models
  7. 2026Beyond Appearance Shifts: Task-Semantic Action Calibration for VLA Models
  8. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge