The Omniglot challenge: a 3-year progress report
Not on the map. Why?
Abstract (arXiv)
Three years ago, we released the Omniglot dataset for one-shot learning, along with five challenge tasks and a computational model that addresses these tasks. The model was not meant to be the final word on Omniglot; we hoped that the community would build on our work and develop new approaches. In the time since, we have been pleased to see wide adoption of the dataset. There has been notable progress on one-shot classification, but researchers have adopted new splits and procedures that make the task easier. There has been less progress on the other four tasks. We conclude that recent approaches are still far from human-like concept learning on Omniglot, a challenge that requires performing many tasks with a single model.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 10; 2023: 16; 2024: 14; 2025: 0; 2026: 4.
54 papers.
Sort:
By area:
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2022Data Distributional Properties Drive Emergent In-Context Learning in Transformerscited by 303
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2023The mechanistic basis of data dependence and abrupt learning in an in-context classification taskcited by 115
- 2021Opening up Open-World Trackingcited by 50
- 2023MEWL: Few-shot multimodal word learning with referential uncertaintycited by 17
- 2023Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery Approachcited by 17
- 2023Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Abilitycited by 16
- 2024Frozen Feature Augmentation for Few-Shot Image Classificationcited by 13
- 2023Towards Task Sampler Learning for Meta-Learningcited by 11
- 2023Diffusion Models as Artists: Are we Closing the Gap between Humans and Machines?cited by 10
- 2024Anchor function: a type of benchmark functions for studying language modelscited by 10
38 more
- 2022Interactive Visual Reasoning under Uncertaintycited by 8
- 2023Hacking Task Confounder in Meta-Learningcited by 8
- 2023Compositional diversity in visual concept learningcited by 7
- 2021Set-to-Sequence Methods in Machine Learning: a Reviewcited by 6
- 2022Drawing out of Distribution with Neuro-Symbolic Generative Modelscited by 5
- 2024On-device Online Learning and Semantic Management of TinyML Systemscited by 5
- 2026Dissecting Multimodal In-Context Learning: Modality Asymmetries and Circuit Dynamics in modern Transformerscited by 5
- 2022Learning from One and Only One Shotcited by 4
- 2022Adaptive Prototypical Networkscited by 4
- 2023A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniquescited by 4
- 2023TinyReptile: TinyML with Federated Meta-Learningcited by 4
- 2021Meta-learning of Pooling Layers for Character Recognitioncited by 3
- 2024Latent Representation Matters: Human-like Sketches in One-shot Drawing Taskscited by 3
- 2021Embedding Adaptation is Still Needed for Few-Shot Learningcited by 2
- 2022Offline Handwritten Amharic Character Recognition Using Few-shot Learningcited by 2
- 2023Guided Transfer Learningcited by 2
- 2023Meta-Learning in Spiking Neural Networks with Reward-Modulated STDPcited by 2
- 2023Unleash Model Potential: Bootstrapped Meta Self-supervised Learningcited by 2
- 2024Learning to Infer Generative Template Programs for Visual Conceptscited by 2
- 2024GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGAcited by 2
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learningcited by 2
- 2021One-shot learning for the long term: consolidation with an artificial hippocampal algorithmcited by 1
- 2021Learning from the Tangram to Solve Mini Visual Taskscited by 1
- 2022Fast Learning of Dynamic Hand Gesture Recognition with Few-Shot Learning Modelscited by 1
- 2023Computing with Categories in Machine Learningcited by 1
- 2023Advancing Counterfactual Inference through Nonlinear Quantile Regressioncited by 1
- 2024On the Universality of Self-Supervised Learningcited by 1
- 2024Rethinking Meta-Learning from a Learning Lenscited by 1
- 2024BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentationcited by 1
- 2026Contrastive-to-Self-Supervised: A Two-Stage Framework for Script Similarity Learningcited by 1
- 2021Prototypical Region Proposal Networks for Few-Shot Localization and Classificationcited by 0
- 2021A Relational Model for One-Shot Classificationcited by 0
- 2021Meta-Learning and Self-Supervised Pretraining for Real World Image Translationcited by 0
- 2022Distributed Evolution Strategies Using TPUs for Meta-Learningcited by 0
- 2022A Probabilistic Generative Model of Free Categoriescited by 0
- 2023ViewMix: Augmentation for Robust Representation in Self-Supervised Learningcited by 0
- 2024Guided Sketch-Based Program Induction by Search Gradientscited by 0
- 2024Non-negative Subspace Feature Representation for Few-shot Learning in Medical Imagingcited by 0
50 most cited of 54 All 54 (JSON)
- 2026Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks9 Jun 2026
- 2026Contrastive-to-Self-Supervised: A Two-Stage Framework for Script Similarity Learning6 Mar 2026
- 2026Differentiable Inverse Graphics for Zero-shot Scene Reconstruction and Robot Grasping4 Feb 2026
- 2026Dissecting Multimodal In-Context Learning: Modality Asymmetries and Circuit Dynamics in modern Transformers28 Jan 2026
- 2024BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation20 Nov 2024
- 2024Neuromodulated Meta-Learning11 Nov 2024
- 2024Rethinking Meta-Learning from a Learning Lens13 Sep 2024
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learning12 Sep 2024
- 2024Latent Representation Matters: Human-like Sketches in One-shot Drawing Tasks10 Jun 2024
- 2024Perturbing the Gradient for Alleviating Meta Overfitting20 May 2024
- 2024On-device Online Learning and Semantic Management of TinyML Systems13 May 2024
- 2024On the Universality of Self-Supervised Learning2 May 2024
38 more
- 2024GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGA10 Apr 2024
- 2024Non-negative Subspace Feature Representation for Few-shot Learning in Medical Imaging3 Apr 2024
- 2024Learning to Infer Generative Template Programs for Visual Concepts20 Mar 2024
- 2024Frozen Feature Augmentation for Few-Shot Image Classification15 Mar 2024
- 2024Guided Sketch-Based Program Induction by Search Gradients10 Feb 2024
- 2024Anchor function: a type of benchmark functions for studying language models16 Jan 2024
- 2023Hacking Task Confounder in Meta-Learning10 Dec 2023
- 2023The mechanistic basis of data dependence and abrupt learning in an in-context classification task3 Dec 2023
- 2023Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery Approach28 Oct 2023
- 2023Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability12 Oct 2023
- 2023ViewMix: Augmentation for Robust Representation in Self-Supervised Learning6 Sep 2023
- 2023Unleash Model Potential: Bootstrapped Meta Self-supervised Learning28 Aug 2023
- 2023Towards Task Sampler Learning for Meta-Learning18 Jul 2023
- 2023Advancing Counterfactual Inference through Nonlinear Quantile Regression9 Jun 2023
- 2023Meta-Learning in Spiking Neural Networks with Reward-Modulated STDP7 Jun 2023
- 2023MEWL: Few-shot multimodal word learning with referential uncertainty1 Jun 2023
- 2023Compositional diversity in visual concept learning30 May 2023
- 2023TinyReptile: TinyML with Federated Meta-Learning11 Apr 2023
- 2023Guided Transfer Learning26 Mar 2023
- 2023Computing with Categories in Machine Learning7 Mar 2023
- 2023A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques16 Feb 2023
- 2023Diffusion Models as Artists: Are we Closing the Gap between Humans and Machines?27 Jan 2023
- 2022Fast Learning of Dynamic Hand Gesture Recognition with Few-Shot Learning Models16 Dec 2022
- 2022Adaptive Prototypical Networks22 Nov 2022
- 2022Offline Handwritten Amharic Character Recognition Using Few-shot Learning1 Oct 2022
- 2022Interactive Visual Reasoning under Uncertainty18 Jun 2022
- 2022Drawing out of Distribution with Neuro-Symbolic Generative Models3 Jun 2022
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities13 May 2022
- 2022A Probabilistic Generative Model of Free Categories9 May 2022
- 2022Data Distributional Properties Drive Emergent In-Context Learning in Transformers22 Apr 2022
- 2022Learning from One and Only One Shot14 Jan 2022
- 2022Distributed Evolution Strategies Using TPUs for Meta-Learning1 Jan 2022
- 2021Meta-Learning and Self-Supervised Pretraining for Real World Image Translation22 Dec 2021
- 2021Learning from the Tangram to Solve Mini Visual Tasks12 Dec 2021
- 2021A Relational Model for One-Shot Classification8 Nov 2021
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scans11 Oct 2021
- 2021Opening up Open-World Tracking22 Apr 2021
- 2021Embedding Adaptation is Still Needed for Few-Shot Learning15 Apr 2021
50 newest of 54 All 54 (JSON)
- 2022Interactive Visual Reasoning under Uncertaintycited by 8
- 2022Interactive Visual Reasoning under Uncertainty18 Jun 2022
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2022Data Distributional Properties Drive Emergent In-Context Learning in Transformerscited by 303
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2023The mechanistic basis of data dependence and abrupt learning in an in-context classification taskcited by 115
- 2021Opening up Open-World Trackingcited by 50
- 2023MEWL: Few-shot multimodal word learning with referential uncertaintycited by 17
- 2023Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery Approachcited by 17
- 2023Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Abilitycited by 16
- 2024Frozen Feature Augmentation for Few-Shot Image Classificationcited by 13
- 2023Towards Task Sampler Learning for Meta-Learningcited by 11
- 2024Anchor function: a type of benchmark functions for studying language modelscited by 10
- 2023Hacking Task Confounder in Meta-Learningcited by 8
12 most cited of 50 All 50 (JSON)
- 2026Quo Vadis, Visual In-Context Learning? A Unified Benchmark Across Domains and Tasks9 Jun 2026
- 2026Contrastive-to-Self-Supervised: A Two-Stage Framework for Script Similarity Learning6 Mar 2026
- 2026Differentiable Inverse Graphics for Zero-shot Scene Reconstruction and Robot Grasping4 Feb 2026
- 2024BelHouse3D: A Benchmark Dataset for Assessing Occlusion Robustness in 3D Point Cloud Semantic Segmentation20 Nov 2024
- 2024Neuromodulated Meta-Learning11 Nov 2024
- 2024Rethinking Meta-Learning from a Learning Lens13 Sep 2024
- 2024Bayesian Inverse Graphics for Few-Shot Concept Learning12 Sep 2024
- 2024Perturbing the Gradient for Alleviating Meta Overfitting20 May 2024
- 2024On-device Online Learning and Semantic Management of TinyML Systems13 May 2024
- 2024On the Universality of Self-Supervised Learning2 May 2024
- 2024GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGA10 Apr 2024
- 2024Non-negative Subspace Feature Representation for Few-shot Learning in Medical Imaging3 Apr 2024
12 newest of 50 All 50 (JSON)