mlsanityData to 14 Oct 2026

Mistral 7B

arXiv 2310.06825 ↗First posted 10 Oct 2023cs.CL cs.AI cs.LGcited by 3,164

Not on the map. Why?

Cited by 640 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce Mistral 7B v0.1, a 7-billion-parameter language model engineered for superior performance and efficiency. Mistral 7B outperforms Llama 2 13B across all evaluated benchmarks, and Llama 1 34B in reasoning, mathematics, and code generation. Our model leverages grouped-query attention (GQA) for faster inference, coupled with sliding window attention (SWA) to effectively handle sequences of arbitrary length with a reduced inference cost. We also provide a model fine-tuned to follow instructions, Mistral 7B -- Instruct, that surpasses the Llama 2 13B -- Chat model both on human and automated benchmarks. Our models are released under the Apache 2.0 license.

Key facts. Cited by 3,164 papers in the map (data through 14 Oct 2026). Builds on 24 of its 29 references that are in the map. First posted on arXiv 10 Oct 2023.

Builds on

24 of 29 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  8. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  9. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  10. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  11. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  12. 2021Program Synthesis with Large Language Modelscited by 3,637
12 more
  1. 2020Longformer: The Long-Document Transformercited by 3,413
  2. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  3. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  4. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
  5. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,164
  6. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  7. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  8. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  9. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  10. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  11. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  12. 2018QuAC : Question Answering in Contextcited by 381

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 63; 2024: 1530; 2025: 934; 2026: 637.

3,164 papers.

Sort:

By area:

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  5. 2024Mixtral of Expertscited by 1,823
  6. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  7. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  8. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  9. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
  10. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  11. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  12. 2025Large Language Diffusion Modelscited by 912
38 more
  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  2. 2024DeepSeek-V3 Technical Reportcited by 811
  3. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  4. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  5. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  6. 2024KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cachecited by 637
  7. 2024KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantizationcited by 591
  8. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  9. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
  10. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
  11. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  12. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  13. 2024Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Servecited by 526
  14. 2024Large Language Models: A Surveycited by 525
  15. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
  16. 2024RewardBench: Evaluating Reward Models for Language Modelingcited by 499
  17. 2024Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attackscited by 486
  18. 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
  19. 2024SpinQuant: LLM quantization with learned rotationscited by 471
  20. 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 432
  21. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
  22. 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Modelscited by 402
  23. 2024Jamba: A Hybrid Transformer-Mamba Language Modelcited by 401
  24. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
  25. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 392
  26. 2024The Platonic Representation Hypothesiscited by 382
  27. 2024Alignment faking in large language modelscited by 360
  28. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 344
  29. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
  30. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  31. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  32. 2024Titans: Learning to Memorize at Test Timecited by 328
  33. 2024What matters when building vision-language models?cited by 326
  34. 2024JudgeBench: A Benchmark for Evaluating LLM-based Judgescited by 318
  35. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
  36. 2023Improving Text Embeddings with Large Language Modelscited by 303
  37. 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 301
  38. 2024OLMoE: Open Mixture-of-Experts Language Modelscited by 301

50 most cited of 3,164 All 3,164 (JSON)