mlsanityData to 7 Oct 2026

Not Your Stereo-Typical Estimator: Combining Vision and Language for Volume Perception

arXiv 2604.09886 ↗First posted 10 Apr 2026cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate volume estimation of objects from visual data is a long-standing challenge in computer vision with significant applications in robotics, logistics, and smart health. Existing methods often rely on complex 3D reconstruction pipelines or struggle with the ambiguity inherent in single-view images. To address these limitations, we introduce a new method that fuses implicit 3D cues from stereo vision with explicit prior knowledge from natural language text. Our approach extracts deep features from a stereo image pair and a descriptive text prompt that contains the object's class and an approximate volume, then integrates them using a simple yet effective projection layer into a unified, multi-modal representation for regression. We conduct extensive experiments on public datasets demonstrating that our text-guided approach significantly outperforms vision-only baselines. Our findings show that leveraging even simple textual priors can effectively guide the volume estimation task, paving the way for more context-aware visual measurement systems. Code: https://gitlab.com/viper-purdue/stereo-typical-estimator.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

25 of 52 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
  11. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  12. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
13 more
  1. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  2. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
  3. 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
  4. 2021Nutrition5k: Towards Automatic Nutritional Understanding of Generic Foodcited by 58
  5. 2024Aria Everyday Activities Datasetcited by 38
  6. 2017Two-view 3D Reconstruction for Food Volume Estimationcited by 18
  7. 2024Food Portion Estimation via 3D Object Scalingcited by 12
  8. 2022Image Based Food Energy Estimation With Depth Domain Adaptationcited by 10
  9. 2023DPF-Nutrition: Food Nutrition Estimation via Depth Prediction and Fusioncited by 10
  10. 2024MFP3D: Monocular Food Portion Estimation Leveraging 3D Point Cloudscited by 9
  11. 2024MetaFood CVPR 2024 Challenge on Physically Informed 3D Food Reconstruction: Methods and Resultscited by 8
  12. 2024Nutrition Estimation for Dietary Management: A Transformer Approach with Depth Sensingcited by 4
  13. 2026Food Portion Estimation: From Pixels to Caloriescited by 3

Built on by

Not cited yet.