torchtune: PyTorch native post-training library
Not on the map. Why?
Abstract (arXiv)
Modern LLMs typically require multistage training pipelines to achieve strong downstream performance, with post-training serving as the main interface for adapting open-weight models. We introduce torchtune, a PyTorch-native library designed to streamline the post-training lifecycle of LLMs, enabling efficient fine-tuning, experimentation, and deployment-oriented workflows. Unlike many existing fine-tuning frameworks, which often optimize for ease of use, specialized recipes, or hardware efficiency at the cost of transparency and extensibility, torchtune emphasizes modularity, hackability, and direct access to the underlying PyTorch components. In this paper, we present the design principles behind torchtune, describe how they are reflected in its model builders, training recipes, and distributed training stack, and evaluate the library across representative post-training settings. We compare against popular fine-tuning frameworks, including Axolotl and Unsloth, and show that torchtune provides strong performance and memory efficiency across many settings while remaining flexible enough for rapid research iteration. These results position torchtune as a practical foundation for reproducible LLMs post-training research.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 31 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
15 of 31 references.
References · 15
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2016Training Deep Nets with Sublinear Memory Costcited by 848
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 527
- 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 457
- 20218-bit Optimizers via Block-wise Quantizationcited by 403
3 more
- 2023TorchRL: A data-driven decision-making library for PyTorchcited by 60
- 2024Cut Your Losses in Large-Vocabulary Language Modelscited by 40
- 2025TorchAO: PyTorch-Native Training-to-Serving Model Optimizationcited by 26
Built on by
Not cited yet.