Speed and Conversational Large Language Models: Not All Is About Tokens per Second
Not on the map. Why?
Abstract (arXiv)
The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 5 of its 12 references that are in the map. First posted on arXiv 23 Feb 2025.
Builds on
5 of 12 references.
References · 5
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Mistral 7Bcited by 3,164
Built on by
Citing papers per year: 2025: 2.
2 papers.