Interactive Acquisition of Fine-grained Visual Concepts by Exploiting Semantics of Generic Characterizations in Discourse
Not on the map. Why?
Abstract (arXiv)
Interactive Task Learning (ITL) concerns learning about unforeseen domain concepts via natural interactions with human users. The learner faces a number of significant constraints: learning should be online, incremental and few-shot, as it is expected to perform tangible belief updates right after novel words denoting unforeseen concepts are introduced. In this work, we explore a challenging symbol grounding task--discriminating among object classes that look very similar--within the constraints imposed by ITL. We demonstrate empirically that more data-efficient grounding results from exploiting the truth-conditions of the teacher's generic statements (e.g., "Xs have attribute Z.") and their implicatures in context (e.g., as an answer to "How are Xs and Ys different?", one infers Y lacks attribute Z).
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 8 of its 33 references that are in the map. First posted on arXiv 5 May 2023.
Builds on
8 of 33 references.
References · 8
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2021Fine-Grained Image Analysis with Deep Learning: A Surveycited by 135
- 2017Fine-graind Image Classification via Combining Vision and Languagecited by 51
- 2019Embedding Human Knowledge into Deep Neural Network via Attention Mapcited by 33
- 2015Fine-grained Categorization and Dataset Bootstrapping using Deep Metric Learning with Humans in the Loopcited by 25
- 2018Knowledge-Embedded Representation Learning for Fine-Grained Image Recognitioncited by 13
- 2020ProbRobScene: A Probabilistic Specification Language for 3D Robotic Manipulation Environmentscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.