mlsanityData to 7 Oct 2026

SpaceJAM: a Lightweight and Regularization-free Method for Fast Joint Alignment of Images

arXiv 2407.11850 ↗First posted 16 Jul 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

The unsupervised task of Joint Alignment (JA) of images is beset by challenges such as high complexity, geometric distortions, and convergence to poor local or even global optima. Although Vision Transformers (ViT) have recently provided valuable features for JA, they fall short of fully addressing these issues. Consequently, researchers frequently depend on expensive models and numerous regularization terms, resulting in long training times and challenging hyperparameter tuning. We introduce the Spatial Joint Alignment Model (SpaceJAM), a novel approach that addresses the JA task with efficiency and simplicity. SpaceJAM leverages a compact architecture with only 16K trainable parameters and uniquely operates without the need for regularization or atlas maintenance. Evaluations on SPair-71K and CUB datasets demonstrate that SpaceJAM matches the alignment capabilities of existing methods while significantly reducing computational demands and achieving at least a 10x speedup. SpaceJAM sets a new standard for rapid and effective image alignment, making the process more accessible and efficient. Our code is available at: https://bgu-cs-vil.github.io/SpaceJAM/.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 34 of its 70 references that are in the map. First posted on arXiv 16 Jul 2024.

Builds on

34 of 70 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2016Identity Mappings in Deep Residual Networkscited by 1,960
  10. 2015Spatial Transformer Networkscited by 1,423
  11. 2023Emergent Correspondence from Image Diffusioncited by 437
  12. 2021Deep ViT Features as Dense Visual Descriptorscited by 327
22 more
  1. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 297
  2. 2019SPair-71k: A Large-scale Benchmark for Semantic Correspondencecited by 140
  3. 2017Convolutional neural network architecture for geometric matchingcited by 138
  4. 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
  5. 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 64
  6. 2021GAN-Supervised Dense Visual Alignmentcited by 61
  7. 2017End-to-end weakly-supervised semantic alignmentcited by 60
  8. 2019SFNet: Learning Object-aware Semantic Correspondencecited by 60
  9. 2023Improving Semantic Correspondence with Viewpoint-Guided Spherical Mapscited by 33
  10. 2018Attentive Semantic Alignment with Offset-Aware Correlation Kernelscited by 31
  11. 2022Learning Semantic Correspondence with Sparse Annotationscited by 31
  12. 2023Neural Congealing: Aligning Images to a Joint Semantic Atlascited by 30
  13. 2016Inverse Compositional Spatial Transformer Networkscited by 29
  14. 2018PARN: Pyramidal Affine Regression Networks for Dense Semantic Correspondencecited by 26
  15. 2023ASIC: Aligning Sparse in-the-wild Image Collectionscited by 26
  16. 2020Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networkscited by 25
  17. 2022CoordGAN: Self-Supervised Dense Correspondences Emerge from GANscited by 17
  18. 2020Probabilistic Spatial Transformer Networkscited by 7
  19. 2021Representing Shape Collections with Alignment-Aware Linear Modelscited by 7
  20. 2022A Deep Moving-camera Background Modelcited by 6
  21. 2013Iterative Grassmannian Optimization for Robust Image Alignmentcited by 4
  22. 2019Jointly Aligning Millions of Images with Deep Penalised Reconstruction Congealingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.

  1. 2025Jamais Vu: Exposing the Generalization Gap in Supervised Semantic Correspondencecited by 5
  2. 2025Diffeomorphic Temporal Alignment Nets for Time-series Joint Alignment and Averagingcited by 3
  3. 2025Towards Geometry-Grounded Dense Semantic Matching with VGGT Priorscited by 3
  4. 2025FastJAM: a Fast Joint Alignment Model for Imagescited by 1
  5. 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesiscited by 0