mlsanityData to 14 Oct 2026

SniffyArt: The Dataset of Smelling Persons

arXiv 2311.11888 ↗First posted 20 Nov 2023cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Smell gestures play a crucial role in the investigation of past smells in the visual arts yet their automated recognition poses significant challenges. This paper introduces the SniffyArt dataset, consisting of 1941 individuals represented in 441 historical artworks. Each person is annotated with a tightly fitting bounding box, 17 pose keypoints, and a gesture label. By integrating these annotations, the dataset enables the development of hybrid classification approaches for smell gesture recognition. The datasets high-quality human pose estimation keypoints are achieved through the merging of five separate sets of keypoint annotations per person. The paper also presents a baseline analysis, evaluating the performance of representative algorithms for detection, keypoint estimation, and classification tasks, showcasing the potential of combining keypoint estimation with smell gesture classification. The SniffyArt dataset lays a solid foundation for future research and the exploration of multi-task approaches leveraging pose keypoints and person boxes to advance human gesture and olfactory dimension analysis in historical artworks.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 42 of its 76 references that are in the map. First posted on arXiv 20 Nov 2023.

Builds on

42 of 76 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2020End-to-End Object Detection with Transformerscited by 7,414
  7. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  8. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  9. 2015Fast R-CNNcited by 2,933
  10. 2018YOLOv3: An Incremental Improvementcited by 2,659
  11. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
  12. 2016YOLO9000: Better, Faster, Strongercited by 1,431
30 more
  1. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  2. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  3. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  4. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  5. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
  6. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  7. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
  8. 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
  9. 2022ViTPose: Simple Vision Transformer Baselines for Human Pose Estimationcited by 456
  10. 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 316
  11. 2020A Brief Review of Domain Adaptationcited by 288
  12. 2019HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimationcited by 247
  13. 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 207
  14. 2019PifPaf: Composite Fields for Human Pose Estimationcited by 120
  15. 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
  16. 2019A Survey of Deep Learning-based Object Detectioncited by 106
  17. 2018How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrievalcited by 74
  18. 2020Learning Delicate Local Representations for Multi-Person Pose Estimationcited by 65
  19. 2021Understanding and Creating Art with AI: Review and Outlookcited by 60
  20. 2018Weakly Supervised Object Detection in Artworkscited by 27
  21. 2016Detecting People in Artwork with CNNscited by 25
  22. 2020Towards High Performance Human Keypoint Detectioncited by 20
  23. 2021Improving Object Detection in Art Images Using Only Style Transfercited by 15
  24. 2020Enhancing Human Pose Estimation in Ancient Vase Paintings via Perceptually-grounded Style Transfer Learningcited by 13
  25. 2020An analysis of the transfer learning of convolutional neural networks for artistic imagescited by 11
  26. 2015The Cross-Depiction Problem: Computer Vision Algorithms for Recognising Objects in Artwork and in Photographscited by 10
  27. 2022Semi-supervised Human Pose Estimation in Art-historical Imagescited by 6
  28. 2023ODOR: The ICPR2022 ODeuropa Challenge on Olfactory Object Recognitioncited by 6
  29. 2023Transfer Learning for Olfactory Object Detectioncited by 3
  30. 2022Automatic Analysis of Human Body Representations in Western Artcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 3.

6 papers.

  1. 2024Smell and Emotion: Recognising emotions in smell-related artworkscited by 2
  2. 2024Novel Artistic Scene-Centric Datasets for Effective Transfer Learning in Fragrant Spacescited by 2
  3. 2025Smelly, dense, and spreaded: The Object Detection for Olfactory References (ODOR) datasetcited by 2
  4. 2024Gesture Classification in Artworks Using Contextual Image Featurescited by 1
  5. 2025Automating Iconclass: LLMs and RAG for Large-Scale Classification of Religious Woodcutscited by 1
  6. 2025Data Augmentation via Latent Diffusion Models for Detecting Smell-Related Objects in Historical Artworkscited by 0