mlsanityData to 14 Oct 2026

Gemini: A Family of Highly Capable Multimodal Models

arXiv 2312.11805 ↗First posted 19 Dec 2023cs.CL cs.AI cs.CVcited by 872

Not on the map. Why?

Cited by 552 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI.

Key facts. Cited by 872 papers in the map (data through 14 Oct 2026). First posted on arXiv 19 Dec 2023.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 253; 2025: 339; 2026: 278.

872 papers.

Sort:

By area:

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  3. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  4. 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
  5. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  6. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
  7. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  8. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  9. 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 301
  10. 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 266
  11. 2024Capabilities of Gemini Models in Medicinecited by 237
  12. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
38 more
  1. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  2. 2024Generative Representational Instruction Tuningcited by 233
  3. 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergycited by 214
  4. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  5. 2024Poseidon: Efficient Foundation Models for PDEscited by 200
  6. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  7. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  8. 2024Large Language Model-Brained GUI Agents: A Surveycited by 162
  9. 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agentscited by 159
  10. 2025WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMscited by 155
  11. 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
  12. 2024The Revolution of Multimodal Large Language Models: A Surveycited by 137
  13. 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
  14. 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
  15. 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 116
  16. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
  17. 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 114
  18. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 114
  19. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Modelscited by 113
  20. 2024Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaborationcited by 113
  21. 2025Agentic Large Language Models, a surveycited by 108
  22. 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
  23. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
  24. 2024Advancing Multimodal Medical Capabilities of Geminicited by 90
  25. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 89
  26. 2025SEED-GRPO: Semantic Entropy Enhanced GRPO for Uncertainty-Aware Policy Optimizationcited by 89
  27. 2024A Survey of Resource-efficient LLM and Multimodal Foundation Modelscited by 86
  28. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
  29. 2024CG-Bench: Clue-grounded Question Answering Benchmark for Long Video Understandingcited by 85
  30. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 83
  31. 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 81
  32. 2025AgentPRM: Process Reward Models for LLM Agents via Step-Wise Promise and Progresscited by 77
  33. 2024MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuningcited by 76
  34. 2026Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineeringcited by 74
  35. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  36. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokenscited by 71
  37. 2024LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Modelscited by 70
  38. 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Modelscited by 70

50 most cited of 872 All 872 (JSON)