OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
The rapid integration of Large Vision-Language Models (VLMs) into critical infrastructure promises to revolutionize personalized healthcare and dietary management. However, in the domain of food systems, autonomous agents face a unique and persistent challenge: the "Systemic Information Asymmetry" between visual appearance and intrinsic nutritional composition. Existing benchmarks primarily focus on coarse-grained classification tasks, such as food category recognition, which fail to evaluate the intricate reasoning chain required for real-world dietary management -- specifically, the ability to traverse from identifying hidden ingredients to estimating physical mass, and finally synthesizing safety-critical medical advice. In this paper, we introduce OmniFood-Bench, a comprehensive benchmark constructed from the MM-Food-100K dataset. Unlike previous works, OmniFood-Bench evaluates VLMs across three progressive capabilities: Basic Perception (Ingredients & Cooking Methods), Quantitative Reasoning (Portion Size & Nutritional Profiling), and Safety-Critical Advisory (Disease-Specific Recommendations). We evaluate six state-of-the-art VLMs, including gpt-5.1, gemini-3-flash, and qwen3-vl-8B. Our extensive experiments reveal a startling "Semantic-Physical Gap": while models achieve near-human accuracy in naming dishes, they exhibit catastrophic failure in mass estimation and frequently hallucinate benign advice for high-risk diabetic profiles. This work establishes a rigorous standard for trustworthiness in autonomous agents deployed for public health. The code and datasets are available in: https://anonymous.4open.science/r/OmniFood-Bench-7D0B
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 12 of its 33 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
12 of 33 references.
References · 12
- 2025Qwen3 Technical Reportcited by 8,820
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2024Capabilities of Gemini Models in Medicinecited by 237
- 2018Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Imagescited by 118
- 2024How Alignment and Jailbreak Work: Explain LLM Safety through Intermediate Hidden Statescited by 98
- 2025A Survey of AI Agent Protocolscited by 81
- 2025From Autonomous Agents to Integrated Systems, A New Paradigm: Orchestrated Distributed Intelligencecited by 12
- 2025Capabilities of GPT-5 across critical domains: Is it the next breakthrough?cited by 6
- 2026PersonalQ: Select, Quantize, and Serve Personalized Diffusion Models for Efficient Inferencecited by 6
- 2025CliCARE: Grounding Large Language Models in Clinical Guidelines for Decision Support over Longitudinal Cancer Electronic Health Recordscited by 4
- 2025MM-Food-100K: A 100,000-Sample Multimodal Food Intelligence Dataset with Verifiable Provenancecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain
- 2025Are Vision-Language Models Ready for Dietary Assessment? Exploring the Next Frontier in AI-Powered Food Image Recognition
- 2026Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition
- 2026FAM-Bench: A Multimodal Benchmark for Condition-Aware Food-as-Medicine Reasoning
- 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning
- 2025January Food Benchmark (JFB): A Public Benchmark Dataset and Evaluation Suite for Multimodal Food Analysis
- 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Model
- 2023UMDFood: Vision-language models boost food composition compilation