mlsanityData to 7 Oct 2026

MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing

arXiv 2607.27616 ↗First posted 30 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-image and personalized editing models now synthesize high-fidelity single-subject images with ease. Yet placing multiple named people into shared contact actions such as embrace, carry, or grapple still exposes major failures: fused limbs, invented extremities, and interpenetrating bodies. Existing evaluations largely overlook these anatomical and geometric issues, and VLM-as-a-judge checklists often saturate on Interaction while the errors remain obvious to humans. We introduce MPIE-Bench, a 2,500-sample benchmark of video-mined editing triplets spanning 405 scenes, 14 interaction categories, and four contact densities (C0-C3). We also propose MPIE-Eval, whose two new axes score contact-time geometry from a frozen public multi-person mesh reconstruction. Anatomy asks whether every human-like mass is explained by a complete set of reconstructed bodies, and Interaction asks whether the penetration and surface distance between those bodies match the contact the instruction asked for. Across ten editors, mesh Anatomy tops out at 0.65 and mesh Interaction at 0.72 on two different models, so no single editor is strong on both, while VLM checklists rate the same images above 0.95. A five-rater study confirms that both axes track human judgement more closely than a zero-shot VLM judge, and the rankings hold under ablation of every weight and threshold.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

35 of 45 references.

References · 35

  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  4. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  5. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  6. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  7. 2023Reconstructing Hands in 3D with Transformerscited by 298
  8. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  9. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  10. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
  11. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  12. 2024Multi-HMR: Multi-Person Whole-Body Human Mesh Recovery in a Single Shotcited by 98
23 more
  1. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  2. 2025DreamO: A Unified Framework for Image Customizationcited by 82
  3. 2024Harmony4D: A Video Dataset for In-The-Wild Close Human Interactionscited by 31
  4. 2024HumanRefiner: Benchmarking Abnormal Human Generation and Refining with Coarse-to-fine Pose-Reversible Guidancecited by 24
  5. 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
  6. 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 16
  7. 2023Reconstructing Three-Dimensional Models of Interacting Humanscited by 14
  8. 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editingcited by 11
  9. 2025MultiHuman-Testbench: Benchmarking Image Generation for Multiple Humanscited by 8
  10. 2025PSR: Scaling Multi-Subject Personalized Image Generation with Pairwise Subject-Consistency Rewardscited by 7
  11. 2024CondiMen: Conditional Multi-Person Mesh Recoverycited by 5
  12. 2025SIGMA-GEN: Structure and Identity Guided Multi-subject Assembly for Image Generationcited by 5
  13. 2025Towards Metric-Aware Multi-Person Mesh Recovery by Jointly Optimizing Human Crowd in Camera Spacecited by 3
  14. 2024GroupDiff: Diffusion-based Group Portrait Editingcited by 2
  15. 2024BodyMetric: Evaluating the Realism of Human Bodies in Text-to-Image Generationcited by 2
  16. 2026MIBE: Multi-subject Interaction Benchmark and Evaluator for Personalized Image Generationcited by 2
  17. 2024gDist: Efficient Distance Computation between 3D Meshes on GPUcited by 1
  18. 2026SkeleGuide: Explicit Skeleton Reasoning for Context-Aware Human-in-Place Image Synthesiscited by 1
  19. 2026InsHuman: Towards Natural and Identity-Preserving Human Insertioncited by 1
  20. 2026Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenescited by 1
  21. 2026Towards Anatomically Plausible Human Image Generation via Synthetic Localized Preferencescited by 1
  22. 2026TrioPose: Native Triple-Stream Diffusion Transformers for Pose-Guided Text-to-Image Generationcited by 1
  23. 2026CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models
  2. 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation
  3. 2026COSMI: COmpositional Synthesis of Multi-object Interactions
  4. 2026FACT: Fidelity-Aware Construction of Articulated Twins
  5. 2025Reconstructing Close Human Interaction with Appearance and Proxemics Reasoning
  6. 2025InteractVLM: 3D Interaction Reasoning from 2D Foundational Models
  7. 2025Re-HOLD: Video Hand Object Interaction Reenactment via adaptive Layout-instructed Diffusion Model
  8. 2026THOM: Generating Physically Plausible Hand-Object Meshes From Text