mlsanityData to 7 Oct 2026

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

arXiv 2406.12793 ↗First posted 18 Jun 2024cs.CLcited by 1,096

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most capable models that are trained with all the insights and lessons gained from the preceding three generations of ChatGLM. To date, the GLM-4 models are pre-trained on ten trillions of tokens mostly in Chinese and English, along with a small set of corpus from 24 languages, and aligned primarily for Chinese and English usage. The high-quality alignment is achieved via a multi-stage post-training process, which involves supervised fine-tuning and learning from human feedback. Evaluations show that GLM-4 1) closely rivals or outperforms GPT-4 in terms of general metrics such as MMLU, GSM8K, MATH, BBH, GPQA, and HumanEval, 2) gets close to GPT-4-Turbo in instruction following as measured by IFEval, 3) matches GPT-4 Turbo (128K) and Claude 3 for long context tasks, and 4) outperforms GPT-4 in Chinese alignments as measured by AlignBench. The GLM-4 All Tools model is further aligned to understand user intent and autonomously decide when and which tool(s) touse -- including web browser, Python interpreter, text-to-image model, and user-defined functions -- to effectively complete complex tasks. In practical applications, it matches and even surpasses GPT-4 All Tools in tasks like accessing online information via web browsing and solving math problems using Python interpreter. Over the course, we have open-sourced a series of models, including ChatGLM-6B (three generations), GLM-4-9B (128K, 1M), GLM-4V-9B, WebGLM, and CodeGeeX, attracting over 10 million downloads on Hugging face in the year 2023 alone. The open models can be accessed through https://github.com/THUDM and https://huggingface.co/THUDM.

Key facts. Cited by 1,096 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 44 of its 51 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

44 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Rethinking Benchmark and Contamination for Language Models with Rephrased Samples8 Nov
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct

Other references · 42

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  11. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  12. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
30 more
  1. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  2. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  3. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  4. 2023A Survey of Large Language Modelscited by 2,537
  5. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  7. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
  8. 2020GLU Variants Improve Transformercited by 1,724
  9. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  10. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  11. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  12. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  13. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,085
  14. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
  15. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  16. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  17. 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 700
  18. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  19. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 305
  20. 2023Effective Long-Context Scaling of Foundation Modelscited by 301
  21. 2023SafetyBench: Evaluating the Safety of Large Language Modelscited by 189
  22. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
  23. 2024LongAlign: A Recipe for Long Context Alignment of Large Language Modelscited by 102
  24. 2023WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferencescited by 100
  25. 2024Understanding Emergent Abilities of Language Models from the Loss Perspectivecited by 94
  26. 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusioncited by 72
  27. 2023CharacterGLM: Customizing Chinese Conversational AI Characters with Large Language Modelscited by 34
  28. 2024APAR: LLMs Can Do Auto-Parallel Auto-Regressive Decodingcited by 23
  29. 2024NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Promptscited by 19
  30. 2024Extensive Self-Contrast Enables Feedback-Free Language Model Alignmentcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 232; 2025: 550; 2026: 314.

1,096 papers.

Sort:

By area:

  1. 2024Qwen2 Technical Reportcited by 2,076
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  4. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  5. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  6. 2024MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attentioncited by 375
  7. 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
  8. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  9. 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 291
  10. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
  11. 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 243
  12. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 214
38 more
  1. 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
  2. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  3. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
  4. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
  5. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
  6. 2024Large Language Model-Brained GUI Agents: A Surveycited by 160
  7. 2025Qwen2.5-1M Technical Reportcited by 158
  8. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
  9. 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
  10. 2024Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Inputcited by 132
  11. 2024ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inferencecited by 132
  12. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
  13. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  14. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
  15. 2024OpenCoder: The Open Cookbook for Top-Tier Code Large Language Modelscited by 127
  16. 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
  17. 2024MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentationcited by 118
  18. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
  19. 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
  20. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
  21. 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agentscited by 105
  22. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Modelscited by 102
  23. 2024VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agentscited by 101
  24. 2024On-Device Language Models: A Comprehensive Reviewcited by 101
  25. 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
  26. 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 94
  27. 2024ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Datacited by 92
  28. 2024Large Concept Models: Language Modeling in a Sentence Representation Spacecited by 86
  29. 2024Recent Advances in Speech Language Models: A Surveycited by 85
  30. 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 78
  31. 2025T1: Advancing Language Model Reasoning through Reinforcement Learning and Inference Scalingcited by 77
  32. 2025TreeRL: LLM Reinforcement Learning with On-Policy Tree Searchcited by 75
  33. 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 69
  34. 2024Reinforcement Learning Enhanced LLMs: A Surveycited by 69
  35. 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 69
  36. 2024Multi-Stage Vision Token Dropping: Towards Efficient Multimodal Large Language Modelcited by 67
  37. 2024Imprompter: Tricking LLM Agents into Improper Tool Usecited by 66
  38. 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 65

50 most cited of 1,096 All 1,096 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023PolyLM: An Open Source Polyglot Large Language Model
  2. 2024Multilingual Large Language Models: A Systematic Survey
  3. 2024Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers
  4. 2023An Empirical Study of Instruction-tuning Large Language Models in Chinese
  5. 2024Yi: Open Foundation Models by 01.AI
  6. 2024Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPT
  7. 2023YAYI 2: Multilingual Open-Source Large Language Models
  8. 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias