How Does India Cook Biryani?
Not on the map. Why?
Abstract (arXiv)
Biryani, one of India's most celebrated dishes, exhibits remarkable regional diversity in its preparation, ingredients, and presentation. With the growing availability of online cooking videos, there is unprecedented potential to study such culinary variations using computational tools systematically. However, existing video understanding methods fail to capture the fine-grained, multimodal, and culturally grounded differences in procedural cooking videos. This work presents the first large-scale, curated dataset of biryani preparation videos, comprising 120 high-quality YouTube recordings across 12 distinct regional styles. We propose a multi-stage framework leveraging recent advances in vision-language models (VLMs) to segment videos into fine-grained procedural units and align them with audio transcripts and canonical recipe text. Building on these aligned representations, we introduce a video comparison pipeline that automatically identifies and explains procedural differences between regional variants. We construct a comprehensive question-answer (QA) benchmark spanning multiple reasoning levels to evaluate procedural understanding in VLMs. Our approach employs multiple VLMs in complementary roles, incorporates human-in-the-loop verification for high-precision tasks, and benchmarks several state-of-the-art models under zero-shot and fine-tuned settings. The resulting dataset, comparison methodology, and QA benchmark provide a new testbed for evaluating VLMs on structured, multimodal reasoning tasks and open new directions for computational analysis of cultural heritage through cooking videos. We release all data, code, and the project website at https://farzanashaju.github.io/how-does-india-cook-biryani/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 68 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
19 of 68 references.
References · 19
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
7 more
- 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
- 2015What's Cookin'? Interpreting Cooking Videos using Text, Speech and Visioncited by 31
- 2025Video Action Differencingcited by 14
- 2020A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videoscited by 11
- 2025OSCAR: Object Status and Contextual Awareness for Recipes to Support Non-Visual Cookingcited by 5
- 2023A Review of Machine Learning Methods Applied to Video Analysis Systemscited by 3
- 2022Recipe Generation from Unsegmented Cooking Videoscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Vision and Structured-Language Pretraining for Cross-Modal Food Retrieval
- 2026CulturalMenuBench: Probing the Knowledge-Application Gap in Multimodal Culinary Reasoning
- 2024FoodMLLM-JP: Leveraging Multimodal Large Language Models for Japanese Recipe Generation
- 2024WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
- 2023Food-500 Cap: A Fine-Grained Food Caption Benchmark for Evaluating Vision-Language Models
- 2022Visual Recipe Flow: A Dataset for Learning Visual State Changes of Objects with Recipe Flows
- 2024FoodieQA: A Multimodal Dataset for Fine-Grained Understanding of Chinese Food Culture
- 2025World in a Frame: Understanding Culture Mixing as a New Challenge for Vision-Language Models