DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domain
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advancements in Vision-Language Models (VLMs) have revolutionized general visual understanding. However, their application in the food domain remains constrained by benchmarks that rely on coarse-grained categories, single-view imagery, and inaccurate metadata. To bridge this gap, we introduce DiningBench, a hierarchical, multi-view benchmark designed to evaluate VLMs across three levels of cognitive complexity: Fine-Grained Classification, Nutrition Estimation, and Visual Question Answering. Unlike previous datasets, DiningBench comprises 3,021 distinct dishes with an average of 5.27 images per entry, incorporating fine-grained "hard" negatives from identical menus and rigorous, verification-based nutritional data. We conduct an extensive evaluation of 29 state-of-the-art open-source and proprietary models. Our experiments reveal that while current VLMs excel at general reasoning, they struggle significantly with fine-grained visual discrimination and precise nutritional reasoning. Furthermore, we systematically investigate the impact of multi-view inputs and Chain-of-Thought reasoning, identifying five primary failure modes. DiningBench serves as a challenging testbed to drive the next generation of food-centric VLM research. All codes are released in https://github.com/meituan/DiningBench.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 13 of its 36 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
13 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 11
- 2023GPT-4 Technical Reportcited by 18,132
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 117
- 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026FAM-Bench: A Multimodal Benchmark for Condition-Aware Food-as-Medicine Reasoningcited by 1
- 2026Delegation Intelligence in Deep Search: A Controllable Framework for Disentangled Capability Diagnosiscited by 0
- 2026FlavourBench: Executable Culinary Reward Maps for Language Model Evaluation and Post-Trainingcited by 0
- 2026FlavourBench: Executable Culinary Reward Maps for Language Model Evaluation and Post-Training20 Aug 2026
- 2026Delegation Intelligence in Deep Search: A Controllable Framework for Disentangled Capability Diagnosis26 Jul 2026
- 2026FAM-Bench: A Multimodal Benchmark for Condition-Aware Food-as-Medicine Reasoning29 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Food-R1: A Unified Multi-Task Food Vision-Language Model with Reinforcement Learning
- 2026OmniFood-Bench: Evaluating VLMs for Nutrient Reasoning and Personalized Health Advice
- 2026OliveGemma: A 3 Billion Visual Language Model for Recognising the Mediterranean & European Diet
- 2025Are Vision-Language Models Ready for Dietary Assessment? Exploring the Next Frontier in AI-Powered Food Image Recognition
- 2026FoodSense: A Multisensory Food Dataset and Benchmark for Predicting Taste, Smell, Texture, and Sound from Images
- 2026Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition
- 2023Food-500 Cap: A Fine-Grained Food Caption Benchmark for Evaluating Vision-Language Models
- 2023FoodLMM: A Versatile Food Assistant using Large Multi-modal Model