Are Elephants Bigger than Butterflies? Reasoning about Sizes of Objects
Not on the map. Why?
Abstract (arXiv)
Human vision greatly benefits from the information about sizes of objects. The role of size in several visual reasoning tasks has been thoroughly explored in human perception and cognition. However, the impact of the information about sizes of objects is yet to be determined in AI. We postulate that this is mainly attributed to the lack of a comprehensive repository of size information. In this paper, we introduce a method to automatically infer object sizes, leveraging visual and textual information from web. By maximizing the joint likelihood of textual and visual observations, our method learns reliable relative size estimates, with no explicit human supervision. We introduce the relative size dataset and show that our method outperforms competitive textual and visual baselines in reasoning about size comparisons.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 5; 2024: 5; 2025: 4; 2026: 1.
22 papers.
Sort:
By area:
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2022Things not Written in Text: Exploring Spatial Commonsense from Visual Signalscited by 41
- 2021Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schemacited by 32
- 2023Learning Visual Representations via Language-Guided Samplingcited by 32
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Modelscited by 24
- 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligencecited by 23
- 2023Mitigating Temporal Misalignment by Discarding Outdated Factscited by 21
- 2022Visually-Augmented Language Modelingcited by 18
- 2021Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledgecited by 15
- 2023NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledgecited by 8
- 2021What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficultcited by 4
- 2023ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categoriescited by 4
10 more
- 2025Benchmarking Large and Small MLLMscited by 2
- 2021Inferring spatial relations from textual descriptions of imagescited by 1
- 2024Grounding Spatial Relations in Text-Only Language Modelscited by 1
- 2024LaMI: Augmenting Large Language Models via Late Multi-Image Fusioncited by 1
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entitiescited by 0
- 2024Plausible-Parrots @ MSP2023: Enhancing Semantic Plausibility Modeling using Entity and Event Knowledgecited by 0
- 2024Improving the Efficiency of Visually Augmented Language Modelscited by 0
- 2025Plausibility Vaccine: Injecting LLM Knowledge for Event Plausibilitycited by 0
- 2025TComQA: Extracting Temporal Commonsense from Textcited by 0
- 2026CALIPER: Metric-Grounded Model-Free Recognition of Visually Similar Industrial Partscited by 0
- 2026CALIPER: Metric-Grounded Model-Free Recognition of Visually Similar Industrial Parts15 Sep 2026
- 2025TComQA: Extracting Temporal Commonsense from Text21 Aug 2025
- 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligence9 Jun 2025
- 2025Plausibility Vaccine: Injecting LLM Knowledge for Event Plausibility16 Mar 2025
- 2025Benchmarking Large and Small MLLMs4 Jan 2025
- 2024Improving the Efficiency of Visually Augmented Language Models17 Sep 2024
- 2024Plausible-Parrots @ MSP2023: Enhancing Semantic Plausibility Modeling using Entity and Event Knowledge29 Aug 2024
- 2024LaMI: Augmenting Large Language Models via Late Multi-Image Fusion19 Jun 2024
- 2024Grounding Spatial Relations in Text-Only Language Models20 Mar 2024
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Models12 Mar 2024
- 2023ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categories24 May 2023
- 2023Mitigating Temporal Misalignment by Discarding Outdated Facts24 May 2023
10 more
- 2023NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge8 May 2023
- 2023Language Is Not All You Need: Aligning Perception with Language Models27 Feb 2023
- 2023Learning Visual Representations via Language-Guided Sampling23 Feb 2023
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities31 Oct 2022
- 2022Visually-Augmented Language Modeling20 May 2022
- 2022Things not Written in Text: Exploring Spatial Commonsense from Visual Signals15 Mar 2022
- 2021Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge22 Jul 2021
- 2021Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema16 Apr 2021
- 2021What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult5 Apr 2021
- 2021Inferring spatial relations from textual descriptions of images1 Feb 2021
- 2022Things not Written in Text: Exploring Spatial Commonsense from Visual Signalscited by 41
- 2021Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schemacited by 32
- 2023Learning Visual Representations via Language-Guided Samplingcited by 32
- 2023Mitigating Temporal Misalignment by Discarding Outdated Factscited by 21
- 2022Visually-Augmented Language Modelingcited by 18
- 2021Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledgecited by 15
- 2021What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficultcited by 4
- 2023ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categoriescited by 4
- 2021Inferring spatial relations from textual descriptions of imagescited by 1
- 2024Grounding Spatial Relations in Text-Only Language Modelscited by 1
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entitiescited by 0
- 2024Plausible-Parrots @ MSP2023: Enhancing Semantic Plausibility Modeling using Entity and Event Knowledgecited by 0
12 most cited of 16 All 16 (JSON)
- 2026CALIPER: Metric-Grounded Model-Free Recognition of Visually Similar Industrial Parts15 Sep 2026
- 2025TComQA: Extracting Temporal Commonsense from Text21 Aug 2025
- 2025Plausibility Vaccine: Injecting LLM Knowledge for Event Plausibility16 Mar 2025
- 2024Improving the Efficiency of Visually Augmented Language Models17 Sep 2024
- 2024Plausible-Parrots @ MSP2023: Enhancing Semantic Plausibility Modeling using Entity and Event Knowledge29 Aug 2024
- 2024Grounding Spatial Relations in Text-Only Language Models20 Mar 2024
- 2023ImageNetVC: Zero- and Few-Shot Visual Commonsense Evaluation on 1000 ImageNet Categories24 May 2023
- 2023Mitigating Temporal Misalignment by Discarding Outdated Facts24 May 2023
- 2023Learning Visual Representations via Language-Guided Sampling23 Feb 2023
- 2022Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities31 Oct 2022
- 2022Visually-Augmented Language Modeling20 May 2022
- 2022Things not Written in Text: Exploring Spatial Commonsense from Visual Signals15 Mar 2022
12 newest of 16 All 16 (JSON)