mlsanityData to 7 Oct 2026

DiffAssemble: A Unified Graph-Diffusion Model for 2D and 3D Reassembly

arXiv 2402.19302 ↗First posted 29 Feb 2024cs.CVcited by 31

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Reassembly tasks play a fundamental role in many fields and multiple approaches exist to solve specific reassembly problems. In this context, we posit that a general unified model can effectively address them all, irrespective of the input data type (images, 3D, etc.). We introduce DiffAssemble, a Graph Neural Network (GNN)-based architecture that learns to solve reassembly tasks using a diffusion model formulation. Our method treats the elements of a set, whether pieces of 2D patch or 3D object fragments, as nodes of a spatial graph. Training is performed by introducing noise into the position and rotation of the elements and iteratively denoising them to reconstruct the coherent initial pose. DiffAssemble achieves state-of-the-art (SOTA) results in most 2D and 3D reassembly tasks and is the first learning-based approach that solves 2D puzzles for both rotation and translation. Furthermore, we highlight its remarkable reduction in run-time, performing 11 times faster than the quickest optimization-based method for puzzle solving. Code available at https://github.com/IIT-PAVIS/DiffAssemble

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 38 of its 53 references that are in the map. First posted on arXiv 29 Feb 2024.

Builds on

38 of 53 references.

Closest ancestors · 1

Same direction, newest first

  1. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 37

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2017Graph Attention Networkscited by 8,854
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  7. 2016Group Equivariant Convolutional Networkscited by 1,154
  8. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  9. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  10. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
  11. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
  12. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
25 more
  1. 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 307
  2. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 237
  3. 2023SE(3) diffusion model with application to protein backbone generationcited by 214
  4. 2020Graph-Bert: Only Attention is Needed for Learning Graph Representationscited by 176
  5. 2023Exphormer: Sparse Transformers for Graphscited by 166
  6. 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 141
  7. 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
  8. 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
  9. 2022Expander Graph Propagationcited by 75
  10. 2019IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Taskscited by 68
  11. 2020Generative 3D Part Assembly via Dynamic Graph Learningcited by 65
  12. 2020Learning 3D Part Assembly from a Single Imagecited by 51
  13. 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 50
  14. 2022Neural Shape Mating: Self-Supervised Object Assembly with Adversarial Shape Priorscited by 42
  15. 2022Breaking Bad: A Dataset for Geometric Fracture and Reassemblycited by 38
  16. 2023Leveraging SE(3) Equivariance for Learning 3D Geometric Shape Assemblycited by 27
  17. 2022SigMaNet: One Laplacian to Rule Them Allcited by 23
  18. 2020Deepzzle: Solving Visual Jigsaw Puzzles with Deep Learning andShortest Path Optimizationcited by 19
  19. 2021JigsawGAN: Auxiliary Learning for Solving Jigsaw Puzzles with Generative Adversarial Networkscited by 16
  20. 2015Solving Jigsaw Puzzles with Linear Programmingcited by 9
  21. 2022Spatial Commonsense Graph for Object Localisation in Partial Scenescited by 9
  22. 2022GANzzle: Reframing jigsaw puzzle solving as a retrieval task using a generative mental imagecited by 9
  23. 2018Solving Jigsaw Puzzles By the Graph Connection Laplaciancited by 7
  24. 2023Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic Modelscited by 5
  25. 2022PoserNet: Refining Relative Camera Poses Exploiting Object Detectionscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 13; 2026: 9.

31 papers.

Sort:

By area:

  1. 2024ET-SEED: Efficient Trajectory-Level SE(3) Equivariant Diffusion Policycited by 24
  2. 2024Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solvingcited by 17
  3. 2024PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verifycited by 14
  4. 2025Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Modelscited by 13
  5. 2025Rectified Point Flow: Generic Point Cloud Pose Estimationcited by 13
  6. 2025GARF: Learning Generalizable 3D Reassembly for Real-World Fracturescited by 12
  7. 2025Two by Two: Learning Multi-Task Pairwise Objects Assembly for Generalizable Robot Manipulationcited by 12
  8. 2024A Survey on Computational Solutions for Reconstructing Complete Objects by Reassembling Their Fractured Partscited by 8
  9. 2024EqvAfford: SE(3) Equivariance for Point-Level Affordance Learningcited by 6
  10. 2025Manual2Skill++: Connector-Aware General Robotic Assembly from Instruction Manuals via Vision-Language Modelscited by 5
  11. 2024Jigsaw++: Imagining Complete Shape Priors for Object Reassemblycited by 4
  12. 2024Geometric Point Attention Transformer for 3D Shape Reassemblycited by 3
19 more
  1. 2025BiAssemble: Learning Collaborative Affordance for Bimanual Geometric Assemblycited by 3
  2. 2025PuzLM: Solving Jigsaw Puzzles with Sequence-to-Sequence Language Modelscited by 3
  3. 2024Nash Meets Wertheimer: Using Good Continuation in Jigsaw Puzzlescited by 2
  4. 2025ReassembleNet: Learnable Keypoints and Diffusion for 2D Fresco Reconstructioncited by 2
  5. 2025Equivariant Flow Matching for Point Cloud Assemblycited by 2
  6. 2025Combinative Matching for Geometric Shape Assemblycited by 2
  7. 2026The Missing GAP: From Solving Square Jigsaw Puzzles to Handling Real World Archaeological Fragmentscited by 2
  8. 2024Maps from Motion (MfM): Generating 2D Semantic Maps from Sparse Multi-view Imagescited by 1
  9. 2025Solving Convex Partition Visual Jigsaw Puzzlescited by 1
  10. 2025E-M3RF: An Equivariant Multimodal 3D Re-assembly Frameworkcited by 1
  11. 2026Solving Jigsaw Puzzles in the Wild: Human-Guided Reconstruction of Cultural Heritage Fragmentscited by 1
  12. 2026Interact3D: Compositional 3D Generation of Interactive Objectscited by 1
  13. 2026SARe: Structure-Aware Generative 3D Fragment Reassemblycited by 1
  14. 2026JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzlescited by 1
  15. 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assemblycited by 0
  16. 2026CRAG: Can 3D Generative Models Help 3D Assembly?cited by 0
  17. 2026Transparent Fragments Contour Estimation via Visual-Tactile Fusion for Autonomous Reassemblycited by 0
  18. 2026A Vision Based System for Guided and Collaborative Reconstruction of Fragmented Documentscited by 0
  19. 2026JigSync: Gauge-Resolved Synchronization for Jigsaw Reassembly under Unknown Piece Orientationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Think Before You Paint: Recursive Latent Reasoning for Diffusion Models
  2. 2026From Uniform to Learned Graph Priors: Diffusion for Structure Discovery
  3. 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objects
  4. 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Models
  5. 2024GFPack++: Improving 2D Irregular Packing by Learning Gradient Field with Attention
  6. 2025Assembler: Scalable 3D Part Assembly via Anchor Point Diffusion
  7. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Rooms
  8. 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latent