# TensorFlow: A system for large-scale machine learning

arXiv: https://arxiv.org/abs/1605.08695 · HTML: https://mlsanity.com/paper/1605.08695/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 May 2016.

## Built on by (most cited first, 6 of 6)

- [Tensor Methods for Language Models: From Token Representation to Training, Adaptation, Inference, Compression, and Interpretability](https://mlsanity.com/paper/2608.30505/) (2026)
- [From Weakly Supervised Learning to Active Learning](https://mlsanity.com/paper/2209.11629/) (2022)
- [Physics-informed Neural Networks for Encoding Dynamics in Real Physical Systems](https://mlsanity.com/paper/2401.03534/) (2024)
- [Graph neural networks with configuration cross-attention for tensor compilers](https://mlsanity.com/paper/2405.16623/) (2024)
- [Learning to Represent Surroundings, Anticipate Motion and Take Informed Actions in Unstructured Environments](https://mlsanity.com/paper/2407.10383/) (2024)
- [Diverse Concept Proposals for Concept Bottleneck Models](https://mlsanity.com/paper/2412.18059/) (2024)

## Abstract (arXiv)

TensorFlow is a machine learning system that operates at large scale and in heterogeneous environments. TensorFlow uses dataflow graphs to represent computation, shared state, and the operations that mutate that state. It maps the nodes of a dataflow graph across many machines in a cluster, and within a machine across multiple computational devices, including multicore CPUs, general-purpose GPUs, and custom designed ASICs known as Tensor Processing Units (TPUs). This architecture gives flexibility to the application developer: whereas in previous "parameter server" designs the management of shared state is built into the system, TensorFlow enables developers to experiment with novel optimizations and training algorithms. TensorFlow supports a variety of applications, with particularly strong support for training and inference on deep neural networks. Several Google services use TensorFlow in production, we have released it as an open-source project, and it has become widely used for machine learning research. In this paper, we describe the TensorFlow dataflow model in contrast to existing systems, and demonstrate the compelling performance that TensorFlow achieves for several real-world applications.
