Domain Generalization by Solving Jigsaw Puzzles
Not on the map. Why?
Abstract (arXiv)
Human adaptability relies crucially on the ability to learn and merge knowledge both from supervised and unsupervised learning: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly effective, because supervised learning can never be exhaustive and thus learning autonomously allows to discover invariances and regularities that help to generalize. In this paper we propose to apply a similar approach to the task of object recognition across domains: our model learns the semantic labels in a supervised fashion, and broadens its understanding of the data by learning from self-supervised signals how to solve a jigsaw puzzle on the same images. This secondary task helps the network to learn the concepts of spatial correlation while acting as a regularizer for the classification task. Multiple experiments on the PACS, VLCS, Office-Home and digits datasets confirm our intuition and show that this simple method outperforms previous domain generalization and adaptation solutions. An ablation study further illustrates the inner workings of our approach.
Key facts. Cited by 449 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 130; 2022: 102; 2023: 100; 2024: 52; 2025: 47; 2026: 18.
449 papers.
Sort:
By area:
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2021Domain Generalization: A Surveycited by 760
- 2021Domain Generalization with MixStylecited by 563
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2021A Fourier-based Framework for Domain Generalizationcited by 287
- 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 284
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
- 2021Learning to Diversify for Single Domain Generalizationcited by 170
- 2021FSDR: Frequency Space Domain Randomization for Domain Generalizationcited by 163
38 more
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
- 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
- 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021Causality-inspired Single-source Domain Generalization for Medical Image Segmentationcited by 118
- 2021Open Domain Generalization with Domain-Augmented Meta-Learningcited by 115
- 2021Model-Based Domain Generalizationcited by 103
- 2023Sharpness-Aware Gradient Matching for Domain Generalizationcited by 102
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 97
- 2021Progressive Domain Expansion Network for Single Domain Generalizationcited by 96
- 2023CLIPood: Generalizing CLIP to Out-of-Distributionscited by 96
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
- 2021Invariant Information Bottleneck for Domain Generalizationcited by 86
- 2022NICO++: Towards Better Benchmarking for Domain Generalizationcited by 86
- 2021Adversarially Adaptive Normalization for Single Domain Generalizationcited by 85
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2021Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptationcited by 83
- 2021Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalizationcited by 83
- 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
- 2021Generalizable Person Re-identification with Relevance-aware Mixture of Expertscited by 77
- 2021When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?cited by 76
- 2022Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentationcited by 69
- 2021MixStyle Neural Networks for Domain Generalization and Adaptationcited by 64
- 2021What Does Rotation Prediction Tell Us about Classifier Accuracy under Varying Testing Environments?cited by 63
- 2021Domain Generalization via Gradient Surgerycited by 60
- 2023PromptStyler: Prompt-driven Style Generation for Source-free Domain Generalizationcited by 59
- 2022Occupancy-MAE: Self-supervised Pre-training Large-scale LiDAR Point Clouds with Masked Occupancy Autoencoderscited by 57
- 2021MetaAlign: Coordinating Domain Alignment and Classification for Unsupervised Domain Adaptationcited by 54
- 2021Domain Invariant Representation Learning with Domain Density Transformationscited by 53
- 2021Pareto Self-Supervised Training for Few-Shot Learningcited by 52
- 2022Prompt Vision Transformer for Domain Generalizationcited by 52
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2023Generalist Vision Foundation Models for Medical Imaging: A Case Study of Segment Anything Model on Zero-Shot Medical Segmentationcited by 51
- 2021Test-time Batch Statistics Calibration for Covariate Shiftcited by 50
- 2021Contrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixingcited by 49
- 2021Unsupervised Action Segmentation by Joint Representation Learning and Online Clusteringcited by 48
50 most cited of 449 All 449 (JSON)
- 2026JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles30 Jul 2026
- 2026Source-Free Controlled Adaptation of Teachers for Continual Test-Time Adaptation26 Jul 2026
- 2026CRISP: Constrained Refinement via Iterative Squeezing Process for Robust Medical Image Segmentation under Domain Shift16 Jul 2026
- 2026Label-Decoupled Style Augmentation for Domain Generalization in Multi-Label Remote Sensing Scene Classification14 Jul 2026
- 2026Learning Subset-Shared Invariances for Domain Generalization with Mixture-of-Experts24 Jun 2026
- 2026Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization19 Jun 2026
- 2026MMDG-Bench: A Benchmark for Multimodal Domain Generalization30 May 2026
- 2026The Missing GAP: From Solving Square Jigsaw Puzzles to Handling Real World Archaeological Fragments12 May 2026
- 2026Frequency Adapter with SAM for Generalized Medical Image Segmentation11 May 2026
- 2026Domain-Adaptive Arrhythmia Classification Using a Hybrid Transformer on Wearable Heart Signals5 May 2026
- 2026Boosting Visual Instruction Tuning with Self-Supervised Guidance14 Apr 2026
- 2026Bi-Level Optimization for Single Domain Generalization7 Apr 2026
38 more
- 2026CRISP: Rank-Guided Iterative Squeezing for Robust Medical Image Segmentation under Domain Shift7 Apr 2026
- 2026Jigsaw Regularization in Whole-Slide Image Classification20 Mar 2026
- 2026CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection17 Mar 2026
- 2026Audio-Visual Continual Test-Time Adaptation without Forgetting20 Feb 2026
- 2026DSP-Reg: Domain-Sensitive Parameter Regularization for Robust Domain Generalization27 Jan 2026
- 2026SAFE: Secure and Accurate Federated Learning for Privacy-Preserving Brain-Computer Interfaces9 Jan 2026
- 2025RobustSurg: Tackling domain generalisation for out-of-distribution surgical scene segmentation1 Dec 2025
- 2025Do We Need Perfect Data? Leveraging Noise for Domain Generalized Segmentation28 Nov 2025
- 2025GREAT: Generalizable Representation Enhancement via Auxiliary Transformations for Zero-Shot Environmental Prediction17 Nov 2025
- 2025Diffusion Models are Robust Pretrainers4 Nov 2025
- 2025Environment Inference for Learning Generalizable Dynamical System22 Oct 2025
- 2025Exploring Scale Shift in Crowd Localization under the Context of Domain Generalization22 Oct 2025
- 2025Humanoid-inspired Causal Representation Learning for Domain Generalization18 Oct 2025
- 2025Agentic Jigsaw Interaction Learning for Enhancing Visual Perception and Reasoning in Vision-Language Models1 Oct 2025
- 2025REMAP: Regularized Matching and Partial Alignment of Video Embeddings29 Sep 2025
- 2025Diffusion-Based Action Recognition Generalizes to Untrained Domains10 Sep 2025
- 2025Target-Oriented Single Domain Generalization30 Aug 2025
- 2025Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection23 Aug 2025
- 2025Directed-Tokens: A Robust Multi-Modality Alignment Approach to Large Language-Vision Models19 Aug 2025
- 2025Selective Contrastive Learning for Weakly Supervised Affordance Grounding11 Aug 2025
- 2025Multimodal Causal-Driven Representation Learning for Generalizable Medical Image Segmentation7 Aug 2025
- 2025Procedure Learning via Regularized Gromov-Wasserstein Optimal Transport21 Jul 2025
- 2025Open-set Cross Modal Generalization via Multimodal Unified Representation20 Jul 2025
- 2025Text-Driven Causal Representation Learning for Source-Free Domain Generalization14 Jul 2025
- 2025Rule Learning for Knowledge Graph Reasoning under Agnostic Distribution Shift7 Jul 2025
- 2025Bridging Domain Generalization to Multimodal Domain Generalization via Unified Representations4 Jul 2025
- 2025Continual Adaptation: Environment-Conditional Parameter Generation for Object Detection in Dynamic Scenarios30 Jun 2025
- 2025Why Reinforcement Fine-Tuning Enables MLLMs Preserve Prior Knowledge Better: A Data Perspective30 Jun 2025
- 2025Learning Time-Aware Causal Representation for Model Generalization in Evolving Domains21 Jun 2025
- 2025FEDTAIL: Federated Long-Tailed Domain Generalization with Sharpness-Guided Gradient Matching10 Jun 2025
- 2025How PARTs assemble into wholes: Learning the relative composition of images4 Jun 2025
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles29 May 2025
- 2025ShortcutProbe: Probing Prediction Shortcuts for Learning Robust Models20 May 2025
- 2025Multi-Source Collaborative Style Augmentation and Domain-Invariant Learning for Federated Domain Generalization15 May 2025
- 2025Mamba-Sea: A Mamba-based Framework with Global-to-Local Sequence Augmentation for Generalizable Medical Image Segmentation24 Apr 2025
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systems22 Apr 2025
- 2025Vision and Language Integration for Domain Generalization17 Apr 2025
- 2025Bayesian Cross-Modal Alignment Learning for Few-Shot Out-of-Distribution Generalization13 Apr 2025
50 newest of 449 All 449 (JSON)
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzlescited by 36
- 2023APPLeNet: Visual Attention Parameterized Prompt Learning for Few-Shot Remote Sensing Image Generalization using CLIPcited by 24
- 2025Directed-Tokens: A Robust Multi-Modality Alignment Approach to Large Language-Vision Modelscited by 5
- 2024Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learningcited by 4
- 2025Generalizable Prompt Learning of CLIP: A Brief Overviewcited by 3
- 2025Multimodal Causal-Driven Representation Learning for Generalizable Medical Image Segmentationcited by 2
- 2025Directed-Tokens: A Robust Multi-Modality Alignment Approach to Large Language-Vision Models19 Aug 2025
- 2025Multimodal Causal-Driven Representation Learning for Generalizable Medical Image Segmentation7 Aug 2025
- 2025Jigsaw-R1: A Study of Rule-based Visual Reinforcement Learning with Jigsaw Puzzles29 May 2025
- 2025Generalizable Prompt Learning of CLIP: A Brief Overview3 Mar 2025
- 2024Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning20 May 2024
- 2023APPLeNet: Visual Attention Parameterized Prompt Learning for Few-Shot Remote Sensing Image Generalization using CLIP12 Apr 2023
- 2023Cross Domain Generative Augmentation: Domain Generalization with Latent Diffusion Modelscited by 8
- 2024FDS: Feedback-guided Domain Synthesis with Multi-Source Conditional Diffusion Models for Domain Generalizationcited by 5
- 2026Adversarial Domain Prompt Tuning and Generation for Single Domain Generalizationcited by 4
- 2023Adapt Anything: Tailor Any Image Classifiers across Domains And Categories Using Text-to-Image Diffusion Modelscited by 1
- 2025Diffusion Models are Robust Pretrainerscited by 1
- 2026Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization19 Jun 2026
- 2025Diffusion Models are Robust Pretrainers4 Nov 2025
- 2024FDS: Feedback-guided Domain Synthesis with Multi-Source Conditional Diffusion Models for Domain Generalization4 Jul 2024
- 2023Cross Domain Generative Augmentation: Domain Generalization with Latent Diffusion Models8 Dec 2023
- 2023Adapt Anything: Tailor Any Image Classifiers across Domains And Categories Using Text-to-Image Diffusion Models25 Oct 2023
- 2025Why Reinforcement Fine-Tuning Enables MLLMs Preserve Prior Knowledge Better: A Data Perspectivecited by 14
- 2025Agentic Jigsaw Interaction Learning for Enhancing Visual Perception and Reasoning in Vision-Language Modelscited by 11
- 2026Boosting Visual Instruction Tuning with Self-Supervised Guidancecited by 1
- 2026JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzlescited by 1
- 2026JigShape: Evaluating Visual-Geometric Reasoning in VLMs through Jigsaw Puzzles30 Jul 2026
- 2026Boosting Visual Instruction Tuning with Self-Supervised Guidance14 Apr 2026
- 2025Agentic Jigsaw Interaction Learning for Enhancing Visual Perception and Reasoning in Vision-Language Models1 Oct 2025
- 2025Why Reinforcement Fine-Tuning Enables MLLMs Preserve Prior Knowledge Better: A Data Perspective30 Jun 2025
- 2023UniWorld: Autonomous Driving Pre-training via World Modelscited by 32
- 2023UniWorld: Autonomous Driving Pre-training via World Models14 Aug 2023
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2021Domain Generalization: A Surveycited by 760
- 2021Domain Generalization with MixStylecited by 563
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2021A Fourier-based Framework for Domain Generalizationcited by 287
- 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 284
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
- 2021Learning to Diversify for Single Domain Generalizationcited by 170
- 2021FSDR: Frequency Space Domain Randomization for Domain Generalizationcited by 163
12 most cited of 429 All 429 (JSON)
- 2026Source-Free Controlled Adaptation of Teachers for Continual Test-Time Adaptation26 Jul 2026
- 2026CRISP: Constrained Refinement via Iterative Squeezing Process for Robust Medical Image Segmentation under Domain Shift16 Jul 2026
- 2026Label-Decoupled Style Augmentation for Domain Generalization in Multi-Label Remote Sensing Scene Classification14 Jul 2026
- 2026MMDG-Bench: A Benchmark for Multimodal Domain Generalization30 May 2026
- 2026The Missing GAP: From Solving Square Jigsaw Puzzles to Handling Real World Archaeological Fragments12 May 2026
- 2026Frequency Adapter with SAM for Generalized Medical Image Segmentation11 May 2026
- 2026Domain-Adaptive Arrhythmia Classification Using a Hybrid Transformer on Wearable Heart Signals5 May 2026
- 2026Bi-Level Optimization for Single Domain Generalization7 Apr 2026
- 2026CRISP: Rank-Guided Iterative Squeezing for Robust Medical Image Segmentation under Domain Shift7 Apr 2026
- 2026Jigsaw Regularization in Whole-Slide Image Classification20 Mar 2026
- 2026CD-FKD: Cross-Domain Feature Knowledge Distillation for Robust Single-Domain Generalization in Object Detection17 Mar 2026
- 2026Audio-Visual Continual Test-Time Adaptation without Forgetting20 Feb 2026
12 newest of 429 All 429 (JSON)