What Makes a Good Example? Modeling Exemplar Selection with Neural Network Representations
Not on the map. Why?
Abstract (arXiv)
Teaching requires distilling a rich category distribution into a small set of informative exemplars. Although prior work shows that humans consider both representativeness and diversity when teaching, the computational principles underlying these tradeoffs remain unclear. We address this gap by modeling human exemplar selection using neural network feature representations and principled subset selection criteria. Novel visual categories were embedded along a one-dimensional morph continuum using pretrained vision models, and selection strategies varied in their emphasis on prototypicality, joint representativeness, and diversity. Adult participants selected one to three exemplars to teach a learner. Model-human comparisons revealed that strategies based on joint representativeness, or its combination with diversity, best captured human judgments, whereas purely prototypical or diversity-based strategies performed worse. Moreover, transformer-based representations consistently aligned more closely with human behavior than convolutional networks. These results highlight the potential utility of dataset distillation methods in machine learning as computational models for teaching.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
10 of 23 references.
References · 10
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Dataset Condensation with Gradient Matchingcited by 510
- 2022Privacy for Free: How does Dataset Condensation Help Privacy?cited by 119
- 2023A Comprehensive Survey of Dataset Distillationcited by 114
- 2023On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigmcited by 107
- 2023DataDAM: Efficient Dataset Distillation with Attention Matchingcited by 83
- 2020SecDD: Efficient and Secure Method for Remotely Training Neural Networkscited by 14
- 2023BAL: Balancing Diversity and Novelty for Active Learningcited by 9
- 2023Dataset Distillation Meets Provable Subset Selectioncited by 7
Built on by
Not cited yet.