mlsanityData to 7 Oct 2026

Nemotron-4 340B Technical Report

arXiv 2406.11704 ↗First posted 17 Jun 2024cs.CL cs.AI cs.LGcited by 143

Not on the map. Why?

Cited by 47 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We release the Nemotron-4 340B model family, including Nemotron-4-340B-Base, Nemotron-4-340B-Instruct, and Nemotron-4-340B-Reward. Our models are open access under the NVIDIA Open Model License Agreement, a permissive model license that allows distribution, modification, and use of the models and its outputs. These models perform competitively to open access models on a wide range of evaluation benchmarks, and were sized to fit on a single DGX H100 with 8 GPUs when deployed in FP8 precision. We believe that the community can benefit from these models in various research studies and commercial applications, especially for generating synthetic data to train smaller language models. Notably, over 98% of data used in our model alignment process is synthetically generated, showcasing the effectiveness of these models in generating synthetic data. To further support open research and facilitate model development, we are also open-sourcing the synthetic data generation pipeline used in our model alignment process.

Key facts. Cited by 143 papers in the map (data through 7 Oct 2026). Builds on 48 of its 63 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

48 of 63 references.

References · 48

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  11. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  12. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
36 more
  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  2. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2021Program Synthesis with Large Language Modelscited by 3,509
  6. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  7. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  8. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  9. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  10. 2024Mixtral of Expertscited by 1,785
  11. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  12. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  13. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  14. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  15. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  16. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 865
  17. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
  18. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  19. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 621
  20. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  21. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
  22. 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 480
  23. 2023LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Datasetcited by 449
  24. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
  25. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 246
  26. 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 242
  27. 2024Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferencescited by 176
  28. 2023Platypus: Quick, Cheap, and Powerful Refinement of LLMscited by 150
  29. 2023HelpSteer: Multi-attribute Helpfulness Dataset for SteerLMcited by 140
  30. 2024AEGIS: Online Adaptive AI Content Safety Moderation with Ensemble of LLM Expertscited by 126
  31. 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAGcited by 90
  32. 2024Robust Preference Optimization through Reward Model Distillationcited by 67
  33. 2023ARB: Advanced Reasoning Benchmark for Large Language Modelscited by 60
  34. 2024garak: A Framework for Security Probing Large Language Modelscited by 48
  35. 2024CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialoguescited by 15
  36. 2024BRAIn: Bayesian Reward-conditioned Amortized Inference for natural language generation from feedbackcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 40; 2025: 74; 2026: 29.

143 papers.

Sort:

By area:

  1. 2024Qwen2.5 Technical Reportcited by 4,713
  2. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  4. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  5. 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 322
  6. 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 291
  7. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
  8. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
  9. 2025Generalizing Verifiable Instruction Followingcited by 178
  10. 2024RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Stylecited by 168
  11. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
  12. 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 153
38 more
  1. 2025RM-R1: Reward Modeling as Reasoningcited by 149
  2. 2025RewardBench 2: Advancing Reward Model Evaluationcited by 136
  3. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  4. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
  5. 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Modelscited by 92
  6. 2024Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencentcited by 89
  7. 2025Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Modelscited by 88
  8. 2025OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metricscited by 80
  9. 2024AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modelingcited by 76
  10. 2024Uncertainty-aware Reward Model: Teaching Reward Models to Know What is Unknowncited by 71
  11. 2024Self-Generated Critiques Boost Reward Modeling for Language Modelscited by 69
  12. 2024Preserving Diversity in Supervised Fine-Tuning of Large Language Modelscited by 68
  13. 2025Nemotron-CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-trainingcited by 62
  14. 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Futurecited by 53
  15. 2025Reinforcement Learning from Human Feedbackcited by 53
  16. 2024ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilitiescited by 52
  17. 2024Beyond Examples: High-level Automated Reasoning Paradigm in In-Context Learning via MCTScited by 52
  18. 2024Upcycling Large Language Models into Mixture of Expertscited by 48
  19. 2025Nemotron-Cascade: Scaling Cascaded Reinforcement Learning for General-Purpose Reasoning Modelscited by 45
  20. 2024Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Modelscited by 39
  21. 2025Jet-Nemotron: Efficient Language Model with Post Neural Architecture Searchcited by 39
  22. 2024Direct Judgement Preference Optimizationcited by 33
  23. 2024COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Trainingcited by 32
  24. 2025Nemotron-CrossThink: Scaling Self-Learning beyond Math Reasoningcited by 29
  25. 2024Arena Learning: Build Data Flywheel for LLMs Post-training via Simulated Chatbot Arenacited by 26
  26. 2025Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidancecited by 26
  27. 2025The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong Gainscited by 25
  28. 2024ProSec: Fortifying Code LLMs with Proactive Security Alignmentcited by 24
  29. 2025F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimizationcited by 24
  30. 2025OpenCodeReasoning-II: A Simple Test Time Scaling Approach via Self-Critiquecited by 24
  31. 2024Preference Tuning with Human Feedback on Language, Speech, and Vision Tasks: A Surveycited by 23
  32. 2025ScaleRTL: Scaling LLMs with Reasoning Data and Test-Time Compute for Accurate RTL Code Generationcited by 22
  33. 2024MegaSynth: Scaling Up 3D Scene Reconstruction with Synthesized Datacited by 21
  34. 2024Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Surveycited by 19
  35. 2025Scaling Embedding Layers in Language Modelscited by 19
  36. 2025Mid-Training of Large Language Models: A Surveycited by 18
  37. 2024Puzzle: Distillation-Based NAS for Inference-Optimized LLMscited by 17
  38. 2025Adversarial Training of Reward Modelscited by 17

50 most cited of 143 All 143 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025NVIDIA Nemotron 3: Efficient and Open Intelligence
  2. 2025NVIDIA Nemotron Parse 1.1
  3. 2025NVIDIA Nemotron Nano V2 VL
  4. 2025NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model
  5. 2024NeMo-Aligner: Scalable Toolkit for Efficient Model Alignment
  6. 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence
  7. 2025Llama-Nemotron: Efficient Reasoning Models
  8. 2026OpenRTLSet: A Fully Open-Source Dataset for Large Language Model-based Verilog Module Design