mlsanityData to 14 Oct 2026

FlavourBench: Executable Culinary Reward Maps for Language Model Evaluation and Post-Training

arXiv 2608.20574 ↗First posted 20 Aug 2026cs.AI cs.CY cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce FlavorBench: a benchmark for Compiling Dense Deterministic Answer Maps from a Versioned Culinary Embeddings Model. We test 27 frontier large language model endpoints on 534 substitution, pairing and constraining tasks for tasks that request a 3-ingredient portfolio from 8 candidates and score all 56 resulting portfolios. We conducted multiplicity-controlled paired tests on 101 of 351 model contrasts for this task-set. The largest point estimate on this task-set was achieved by Grok 4.6 at 65.1. The same rankings for this task-set were also achieved on several independently-compiled panels (using a variety of familiar metrics, task filters, etc.) and 3 public Epicure checkpoints. We present a 3-seed post-training study where LoRA SFT of a Qwen3-0.6B checkpoint on 270 optimal answers for Epicure to score on this task-set resulted in a 13.3 point gain on 84 anchor-disjoint maps (compared to format and label-matched control; 95% CI: 6.52, 20.29; p = 0.000170).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

16 of 26 references.

References · 16

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  8. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  9. 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 499
  10. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 262
  11. 2024NutriBench: A Dataset for Evaluating Large Language Models on Nutrition Estimation from Meal Descriptionscited by 17
  12. 2023Learning to Substitute Ingredients in Recipescited by 8
4 more
  1. 2026DiningBench: A Hierarchical Multi-view Benchmark for Perception and Reasoning in the Dietary Domaincited by 3
  2. 2024CookingSense: A Culinary Knowledgebase with Multidisciplinary Assertionscited by 2
  3. 2026Epicure: Multidimensional Flavor Structure in Food Ingredient Embeddingscited by 2
  4. 2026Epicure: Navigating the Emergent Geometry of Food Ingredient Embeddingscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Large Language Models for Ingredient Substitution in Food Recipes using Supervised Fine-tuning and Direct Preference Optimization
  2. 2022Vision and Structured-Language Pretraining for Cross-Modal Food Retrieval
  3. 2026OenoBench: A Wine-Domain Benchmark for Knowledge-Grounded Evaluation of Large Language Models
  4. 2026Enhancing Action and Ingredient Modeling for Semantically Grounded Recipe Generation
  5. 2024Optimizing Language Model's Reasoning Abilities with Weak Supervision
  6. 2024WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
  7. 2026Robust Reward Modeling for Large Language Models via Causal Decomposition
  8. 2025Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Models