mlsanityData to 14 Oct 2026

MBA: Multimodal Benchmark and Agents for Real-World Business Ideation

arXiv 2608.11616 ↗First posted 12 Aug 2026cs.AI cs.CV cs.LGcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Agentic systems powered by large language models (LLMs) have opened new opportunities for business ideation. Yet existing approaches remain confined to a text-only paradigm, despite the inherently multimodal nature of real-world contexts. We thus introduce MBA-Bench, the first multimodal benchmark for training and evaluating business ideation agents, comprising 30K samples across six domains, each domain characterized by distinct visual cues not fully conveyed by text alone. Concretely, we automatically caption images and employ GPT-4o to generate five reference ideas for each of three business questions through retrieval query generation, market evidence retrieval, and evidence-augmented synthesis. Following prior work, we evaluate agents across six business-oriented criteria using MLLM-as-a-Judge. To consider settings where criteria are hidden or disclosed, we present MBA-b and MBA-k for blind and known, respectively. We train both with two novel reward objectives---creativity and feasibility---while MBA-k further optimizes the six disclosed criteria for eight in total. Both are trained via LoRA-based supervised fine-tuning followed by group relative policy optimization with these setting-specific rewards. For extensive experiments on MBA-Bench, we set up two baselines accommodating either captions only or multimodal inputs, with the latter nearing closed-source performance on several metrics. MBA-b and MBA-k outperform caption baselines by 63.9% and 77.1%, and multimodal baselines by 25.6% and 35.8%, respectively.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 34 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

23 of 34 references.

References · 23

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  9. 2013Describing Textures in the Wildcited by 2,125
  10. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  11. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  12. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
11 more
  1. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
  2. 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 177
  3. 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
  4. 2024MLLM can see? Dynamic Correction Decoding for Hallucination Mitigationcited by 88
  5. 2021A Study of the Quality of Wikidatacited by 35
  6. 2019Online PCB Defect Detector On A New PCB Defect Datasetcited by 25
  7. 2023RICO: Regularizing the Unobservable for Indoor Compositional Reconstructioncited by 20
  8. 2023MobileRec: A Large-Scale Dataset for Mobile Apps Recommendationcited by 8
  9. 2025Agent Ideate: A Framework for Product Idea Generation from Patents Using Agentic AIcited by 3
  10. 2025MK2 at PBIG Competition: A Prompt Generation Solutioncited by 3
  11. 2026Debate as Reward: A Multi-Agent Reward System for Scientific Ideation via RL Post-Trainingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Seeing Is Not Deciding: Can Multimodal LLMs Act as Effective CEOs?
  2. 2026FinMTM: A Multi-Turn Multimodal Benchmark for Financial Reasoning and Agent Evaluation
  3. 2025Rethinking Information Synthesis in Multimodal Question Answering A Multi-Agent Perspective
  4. 2024A Survey on Multimodal Benchmarks: In the Era of Large AI Models
  5. 2025Agent Bain vs. Agent McKinsey: A New Text-to-SQL Benchmark for the Business Domain
  6. 2025MDK12-Bench: A Comprehensive Evaluation of Multimodal Large Language Models on Multidisciplinary Exams
  7. 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
  8. 2026A Survey on Foundations and Frontiers of Multimodal Agentic Frameworks: Techniques and Applications