mlsanityData to 14 Oct 2026

PuzLM: Solving Jigsaw Puzzles with Sequence-to-Sequence Language Models

arXiv 2511.06315 ↗First posted 9 Nov 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Square jigsaw puzzles are typically solved by visually matching piece images to recover the original layout. This work introduces PuzLM, an alternative perspective that recasts jigsaw reassembly as a discrete sequence-to-sequence (Seq2Seq) problem, inspired by natural language representations. We design an efficient puzzle quantization procedure that transforms each piece into a short sequence of discrete tokens, enabling the direct application of standard Seq2Seq language models as powerful jigsaw solvers. Our approach demonstrates that accurate puzzle reconstruction can be achieved through purely symbolic reasoning over discrete representations, improving state-of-the-art performance even on puzzles with eroded boundaries or missing pieces.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 38 of its 57 references that are in the map. First posted on arXiv 9 Nov 2025.

Builds on

38 of 57 references.

References · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2017Neural Discrete Representation Learningcited by 4,712
  7. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  8. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  9. 2025DINOv3cited by 1,414
  10. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
  11. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
26 more
  1. 2024An Image is Worth 32 Tokens for Reconstruction and Generationcited by 302
  2. 2019Revisiting Self-Supervised Visual Representation Learningcited by 251
  3. 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
  4. 2018Iterative Reorganization with Weak Spatial Constraints: Solving Arbitrary Jigsaw Puzzles for Unsupervised Representation Learningcited by 51
  5. 2022The Met Dataset: Instance-level Recognition for Artworkscited by 40
  6. 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzlescited by 36
  7. 2024DiffAssemble: A Unified Graph-Diffusion Model for 2D and 3D Reassemblycited by 33
  8. 2020Deepzzle: Solving Visual Jigsaw Puzzles with Deep Learning andShortest Path Optimizationcited by 20
  9. 2024Re-assembling the past: The RePAIR dataset and benchmark for real world 2D and 3D puzzle solvingcited by 19
  10. 2021JigsawGAN: Auxiliary Learning for Solving Jigsaw Puzzles with Generative Adversarial Networkscited by 16
  11. 2018Solving Archaeological Puzzlescited by 15
  12. 2017A Genetic Algorithm-Based Solver for Very Large Jigsaw Puzzlescited by 13
  13. 2024Analyzing The Language of Visual Tokenscited by 12
  14. 2024Solving Masked Jigsaw Puzzles with Diffusion Vision Transformerscited by 11
  15. 2025From Principles to Applications: A Comprehensive Survey of Discrete Tokenizers in Generation, Comprehension, Recommendation, and Information Retrievalcited by 11
  16. 2020Pictorial and apictorial polygonal jigsaw puzzles from arbitrary number of crossing cutscited by 10
  17. 2022GANzzle: Reframing jigsaw puzzle solving as a retrieval task using a generative mental imagecited by 10
  18. 2025Jigsaw-Puzzles: From Seeing to Understanding to Reasoning in Vision-Language Modelscited by 9
  19. 2023Multi-Phase Relaxation Labeling for Square Jigsaw Puzzle Solvingcited by 7
  20. 2017DNN-Buddies: A Deep Neural Network-Based Estimation Metric for the Jigsaw Puzzle Problemcited by 6
  21. 2025Pairwise Alignment & Compatibility for Arbitrarily Irregular Image Fragmentscited by 6
  22. 2025ERL-MPP: Evolutionary Reinforcement Learning with Multi-head Puzzle Perception for Solving Large-scale Jigsaw Puzzles of Eroded Gapscited by 5
  23. 2025Recognizing Artistic Style of Archaeological Image Fragments Using Deep Style Extrapolationcited by 4
  24. 2025VLHSA: Vision-Language Hierarchical Semantic Alignment for Jigsaw Puzzle Solving with Eroded Gapscited by 4
  25. 2022Capturing the Denoising Effect of PCA via Compression Ratiocited by 3
  26. 2025A Generic Hybrid Framework for 2D Visual Reconstructioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Missing GAP: From Solving Square Jigsaw Puzzles to Handling Real World Archaeological Fragments
  2. 2025Benchmarking Content-Based Puzzle Solvers on Corrupted Jigsaw Puzzles
  3. 2024Puzzle Solving using Reasoning of Large Language Models: A Survey
  4. 2026PuzzleMate: Benchmarking MLLMs for Egocentric Puzzle Assistance
  5. 2024Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning
  6. 2025PuzzleWorld: A Benchmark for Multimodal, Open-Ended Reasoning in Puzzlehunts
  7. 2026Eye-Q: A Multilingual Benchmark for Visual Word Puzzle Solving and Image-to-Phrase Reasoning
  8. 2026MaxSAT-Based Feedback for Guiding Vision-Language Models in Sudoku