mlsanityData to 14 Oct 2026

CodeGemma: Open Code Models Based on Gemma

arXiv 2406.11409 ↗First posted 17 Jun 2024cs.CL cs.AIcited by 150

Not on the map. Why?

Abstract (arXiv)

This paper introduces CodeGemma, a collection of specialized open code models built on top of Gemma, capable of a variety of code and natural language generation tasks. We release three model variants. CodeGemma 7B pretrained (PT) and instruction-tuned (IT) variants have remarkably resilient natural language understanding, excel in mathematical reasoning, and match code capabilities of other open models. CodeGemma 2B is a state-of-the-art code completion model designed for fast code infilling and open-ended generation in latency-sensitive settings.

Key facts. Cited by 150 papers in the map (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

18 of 29 references.

References · 18

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  5. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  6. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  7. 2021Program Synthesis with Large Language Modelscited by 3,637
  8. 2023Qwen Technical Reportcited by 3,344
  9. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  10. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  11. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  12. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
6 more
  1. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  2. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
  3. 2017Program Induction by Rationale Generation : Learning to Solve and Explain Algebraic Word Problemscited by 650
  4. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
  5. 2022Efficient Training of Language Models to Fill in the Middlecited by 255
  6. 2023Measuring The Impact Of Programming Language Distributioncited by 32

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 45; 2025: 80; 2026: 25.

150 papers.

Sort:

By area:

  1. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 426
  2. 2024Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planningcited by 97
  3. 2025Learn-by-interact: A Data-Centric Framework for Self-Adaptive Agents in Realistic Environmentscited by 95
  4. 2024CodeRAG-Bench: Can Retrieval Augment Code Generation?cited by 91
  5. 2024Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Surveycited by 83
  6. 2024BOND: Aligning LLMs with Best-of-N Distillationcited by 76
  7. 2024Building Math Agents with Multi-Turn Iterative Preference Learningcited by 66
  8. 2024Lingma SWE-GPT: An Open Development-Process-Centric Language Model for Automated Software Improvementcited by 61
  9. 2024Granite-Function Calling Model: Introducing Function Calling Abilities via Multi-task Learning of Granular Taskscited by 52
  10. 2025Beyond Chemical QA: Evaluating LLM's Chemical Reasoning with Modular Chemical Operationscited by 49
  11. 2025Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMscited by 47
  12. 2025Feedback Descent: Open-Ended Text Optimization via Pairwise Comparisoncited by 44
38 more
  1. 2025A Survey of Research in Large Language Models for Electronic Design Automationcited by 41
  2. 2024Benchmarking Language Model Creativity: A Case Study on Code Generationcited by 40
  3. 2024Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verificationcited by 40
  4. 2025LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarkscited by 37
  5. 2024CodeXEmbed: A Generalist Embedding Model Family for Multiligual and Multi-task Code Retrievalcited by 34
  6. 2024Automated Proof Generation for Rust Code via Self-Evolutioncited by 33
  7. 2025The ML.ENERGY Benchmark: Toward Automated Inference Energy Measurement and Optimizationcited by 33
  8. 2024CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?cited by 30
  9. 2024How Does Code Pretraining Affect Language Model Task Performance?cited by 28
  10. 2025Reinforce LLM Reasoning through Multi-Agent Reflectioncited by 27
  11. 2025FEABench: Evaluating Language Models on Multiphysics Reasoning Abilitycited by 22
  12. 2026Composer 2 Technical Reportcited by 22
  13. 2024On Mitigating Code LLM Hallucinations with API Documentationcited by 21
  14. 2024An LLM Agent for Automatic Geospatial Data Analysiscited by 21
  15. 2024M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluationcited by 21
  16. 2024ExecRepoBench: Multi-level Executable Code Completion Evaluationcited by 20
  17. 2024CodeRosetta: Pushing the Boundaries of Unsupervised Code Translation for Parallel Programmingcited by 19
  18. 2025Free Draft-and-Verification: Toward Lossless Parallel Decoding for Diffusion Large Language Modelscited by 19
  19. 2026DreamOn: Diffusion Language Models For Code Infilling Beyond Fixed-size Canvascited by 19
  20. 2024Codev-Bench: How Do LLMs Understand Developer-Centric Code Completion?cited by 18
  21. 2025IPO: Your Language Model is Secretly a Preference Classifiercited by 17
  22. 2025Agent-Q: Fine-Tuning Large Language Models for Quantum Circuit Generation and Optimizationcited by 17
  23. 2024CodeACT: Code Adaptive Compute-efficient Tuning Framework for Code LLMscited by 15
  24. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 15
  25. 2024LiCoEval: Evaluating LLMs on License Compliance in Code Generationcited by 14
  26. 2025Constrained Decoding of Diffusion LLMs with Context-Free Grammarscited by 14
  27. 2024Are Large Language Models Memorizing Bug Benchmarks?cited by 12
  28. 2025ReCode: Updating Code API Knowledge with Reinforcement Learningcited by 12
  29. 2026GraphPlanner: Graph Memory-Augmented Agentic Routing for Multi-Agent LLMscited by 12
  30. 2024From Introspection to Best Practices: Principled Analysis of Demonstrations in Multimodal In-Context Learningcited by 11
  31. 2024Scaling Granite Code Models to 128K Contextcited by 11
  32. 2024ChatVis: Automating Scientific Visualization with a Large Language Modelcited by 11
  33. 2025How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Codecited by 11
  34. 2025SWE-Compass: Towards Unified Evaluation of Agentic Coding Abilities for Large Language Modelscited by 11
  35. 2024DreamGarden: A Designer Assistant for Growing Games from a Single Promptcited by 10
  36. 2025Privacy Ripple Effects from Adding or Removing Personal Information in Language Model Trainingcited by 10
  37. 2025Active Layer-Contrastive Decoding Reduces Hallucination in Large Language Model Generationcited by 10
  38. 2025FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Datacited by 10

50 most cited of 150 All 150 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance
  2. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement
  3. 2024Assessing Code Generation with Intermediate Languages
  4. 2025A Code Comprehension Benchmark for Large Language Models for Code
  5. 2025Cross-Task Benchmarking and Evaluation of General-Purpose and Code-Specific Large Language Models ↗
  6. 2023L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language Models
  7. 2024MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code