mlsanityData to 14 Oct 2026

Hermes 3 Technical Report

arXiv 2408.11857 ↗First posted 15 Aug 2024cs.CLcited by 34

Not on the map. Why?

Abstract (arXiv)

Instruct (or "chat") tuned models have become the primary way in which most people interact with large language models. As opposed to "base" or "foundation" models, instruct-tuned models are optimized to respond to imperative statements. We present Hermes 3, a neutrally-aligned generalist instruct and tool use model with strong reasoning and creative abilities. Its largest version, Hermes 3 405B, achieves state of the art performance among open weight models on several public benchmarks.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 15 Aug 2024.

Builds on

22 of 34 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  5. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  9. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  10. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  11. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  12. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
10 more
  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  2. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  3. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
  4. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  5. 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
  6. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  7. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  8. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  9. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 201
  10. 2023NEFTune: Noisy Embeddings Improve Instruction Finetuningcited by 100

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 12; 2026: 14.

34 papers.

Sort:

By area:

  1. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  2. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  3. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 135
  4. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 91
  5. 2024Refusal Tokens: A Simple Way to Calibrate Refusals in Large Language Modelscited by 14
  6. 2025Guided Code Generation with LLMs: A Multi-Agent Framework for Complex Code Taskscited by 8
  7. 2024Baichuan Alignment Technical Reportcited by 6
  8. 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robotscited by 5
  9. 2025Decomposing Behavioral Phase Transitions in LLMs: Order Parameters for Emergent Misalignmentcited by 5
  10. 2025Hala Technical Report: Building Arabic-Centric Instruction & Translation Models at Scalecited by 5
  11. 2026Kwai Keye-VL-2.0 Technical Reportcited by 5
  12. 2025WILDCHAT-50M: A Deep Dive Into the Role of Synthetic Data in Post-Trainingcited by 4
22 more
  1. 2025Mining Useful General Data for Low-Resource Domain Adaptationcited by 4
  2. 2026Expected Harm: Rethinking Safety Evaluation of (Mis)Aligned LLMscited by 4
  3. 2024Drama Engine: A Framework for Narrative Agentscited by 3
  4. 2025Fast Proxies for LLM Robustness Evaluationcited by 3
  5. 2025HASHIRU: Hierarchical Agent System for Hybrid Intelligent Resource Utilizationcited by 2
  6. 2025MODA: MOdular Duplex Attention for Multimodal Perception, Cognition, and Emotion Understandingcited by 2
  7. 2025What Is Preference Optimization Doing, and Why?cited by 2
  8. 2024Fine-Tuning Open-Weight Language Models to Deliver Cognitive Behavioral Therapy for Depression: A Feasibility Studycited by 1
  9. 2026HEBATRON: A Hebrew-Specialized Open-Weight Mixture-of-Experts Language Modelcited by 1
  10. 2026Small Foundation Models of Human Cognition and Behaviourcited by 1
  11. 2024Can a Large Language Model Learn Matrix Functions In Context?cited by 0
  12. 2025Leveraging Information Retrieval to Enhance Spoken Language Understanding Prompts in Few-Shot Learningcited by 0
  13. 2026LPCAN: Lightweight Pyramid Cross-Attention Network for Rail Surface Defect Detection Using RGB-D Datacited by 0
  14. 2026Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Methodcited by 0
  15. 2026The Diffusion Duet: Harmonizing Dual Channels with Wavelet Suppression for Image Separationcited by 0
  16. 2026Detecting Deepfakes with Multivariate Soft Blending and CLIP-based Image-Text Alignmentcited by 0
  17. 2026Efficient Image Super-Resolution with Multi-Scale Spatial Adaptive Attention Networkscited by 0
  18. 2026A Deformable Attention-Based Detection Transformer with Cross-Scale Feature Fusion for Industrial Coil Spring Inspectioncited by 0
  19. 2026Same Targets, Different Computation: How Post-Training Divides Work Across Model Layerscited by 0
  20. 2026MIRAI: Prediction and Generation of High-Impact Academic Researchcited by 0
  21. 2026ELEVATE: Designing Human-Centered GenAI Virtual Tutors for Scalable and Inclusive Educationcited by 0
  22. 2026Performance Foundations of Parallel & Distributed Reasoning Language Modelscited by 0