# Improving Image-Based Nutrition Estimation Through Multimodal Food-Item Verification and Recovery

arXiv: https://arxiv.org/abs/2610.11144 · HTML: https://mlsanity.com/paper/2610.11144/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 0 of its 24 references that are in the map.
- First posted on arXiv 8 Oct 2026.

## Abstract (arXiv)

Single-image nutrition estimation can fail silently when visible foods are missed. Even when a food is correctly identified, its proposed region may not support portion estimation. We propose a framework that uses multimodal large language models (MLLMs) to inventory visible foods and separately verify food identity and whether each proposed 2D region supports portion estimation. One whole-image review uses these verification results to identify unresolved gaps and omitted foods, triggering at most one targeted recovery pass. Recovered regions are re-verified without access to the recovery prompt, then reconciled into a final item set for nutrition estimation. The framework requires no task-specific fine-tuning. Matched evaluation on common valid-output samples shows that item-level grounding improves mass accuracy across all tested settings and energy accuracy relative to an adapted retrieval baseline, with item-identity precision and recall also improving, while post-recovery visual coverage is assessed separately at inference time without ground-truth annotations.