mlsanityData to 7 Oct 2026

DragAPart: Learning a Part-Level Motion Prior for Articulated Objects

arXiv 2403.15382 ↗First posted 22 Mar 2024cs.CVcited by 32

Not on the map. Why?

Abstract (arXiv)

We introduce DragAPart, a method that, given an image and a set of drags as input, generates a new image of the same object that responds to the action of the drags. Differently from prior works that focused on repositioning objects, DragAPart predicts part-level interactions, such as opening and closing a drawer. We study this problem as a proxy for learning a generalist motion model, not restricted to a specific kinematic structure or object category. We start from a pre-trained image generator and fine-tune it on a new synthetic dataset, Drag-a-Move, which we introduce. Combined with a new encoding for the drags and dataset randomization, the model generalizes well to real images and different categories. Compared to prior motion-controlled generators, we demonstrate much better part-level motion understanding.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 73 of its 81 references that are in the map. First posted on arXiv 22 Mar 2024.

Builds on

73 of 81 references.

References · 73

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2023GPT-4 Technical Reportcited by 18,132
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  10. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  11. 2023Segment Anythingcited by 8,158
  12. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
38 more
  1. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  9. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  10. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  11. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  13. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  14. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  15. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  16. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  17. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  18. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  19. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  20. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  21. 2022Human Motion Diffusion Modelcited by 1,062
  22. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  23. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  24. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  25. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  26. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  27. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  28. 2023CoTracker: It is Better to Track Togethercited by 516
  29. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
  30. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  31. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
  32. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
  33. 20163D Menagerie: Modeling the 3D shape and pose of animalscited by 310
  34. 2022Novel View Synthesis with Diffusion Modelscited by 299
  35. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
  36. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  37. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  38. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 17; 2026: 9.

32 papers.

Sort:

By area:

  1. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  2. 2024InstantDrag: Improving Interactivity in Drag-based Image Editingcited by 30
  3. 2024Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamicscited by 28
  4. 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 24
  5. 2025Particulate: Feed-Forward 3D Object Articulationcited by 20
  6. 2024LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videoscited by 18
  7. 2025PartRM: Modeling Part-Level Dynamics with Large Cross-State Reconstruction Modelcited by 15
  8. 2025Training-free Geometric Image Editing on Diffusion Modelscited by 13
  9. 20253D-Fixup: Advancing Photo Editing with 3D Priorscited by 12
  10. 2024Motion Modes: What Could Happen Next?cited by 11
  11. 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priorscited by 9
  12. 2025TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generationcited by 9
20 more
  1. 2025C-Drag: Chain-of-Thought Driven Motion Controller for Video Generationcited by 6
  2. 2025Is Single-View Mesh Reconstruction Ready for Robotics?cited by 6
  3. 2025GPS as a Control Signal for Image Generationcited by 5
  4. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  5. 2026Seed3D 2.0: Advancing High-Fidelity Simulation-Ready 3D Content Generationcited by 4
  6. 2025DragMesh: Interactive 3D Generation Made Easycited by 3
  7. 2025DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Predictioncited by 2
  8. 2025What If : Understanding Motion Through Sparse Interactionscited by 2
  9. 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
  10. 2026LooseControlVideo: Directorial Video Control using Spatial Blockingcited by 2
  11. 2025RealDrag: The First Dragging Benchmark with Real Target Imagecited by 1
  12. 2025GIFT: Generated Indoor video frames for Texture-less point trackingcited by 0
  13. 2025MotionDiff: Training-free Zero-shot Interactive Motion Editing via Flow-assisted Multi-view Diffusioncited by 0
  14. 2025Motion Marionette: Rethinking Rigid Motion Transfer via Prior Guidancecited by 0
  15. 2026DynaDrag: Dynamic Drag-Style Image Editing by Motion Predictioncited by 0
  16. 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
  17. 2026Sketch2Arti: Sketch-based Articulation Modeling of CAD Objectscited by 0
  18. 2026In-context Region-based Drag: Drag Any Region to Any Shapecited by 0
  19. 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
  20. 2026Articulated Object Reconstruction from Rest-State Observationcited by 0