mlsanityData to 14 Oct 2026

Interactive Supercomputing on 40,000 Cores for Machine Learning and Data Analysis

arXiv 1807.07814 ↗First posted 20 Jul 2018cs.DCcited by 110

Not on the map. Why?

Abstract (arXiv)

Interactive massively parallel computations are critical for machine learning and data analysis. These computations are a staple of the MIT Lincoln Laboratory Supercomputing Center (LLSC) and has required the LLSC to develop unique interactive supercomputing capabilities. Scaling interactive machine learning frameworks, such as TensorFlow, and data analysis environments, such as MATLAB/Octave, to tens of thousands of cores presents many technical challenges - in particular, rapidly dispatching many tasks through a scheduler, such as Slurm, and starting many instances of applications with thousands of dependencies. Careful tuning of launches and prepositioning of applications overcome these challenges and allow the launching of thousands of tasks in seconds on a 40,000-core supercomputer. Specifically, this work demonstrates launching 32,000 TensorFlow processes in 4 seconds and launching 262,000 Octave processes in 40 seconds. These capabilities allow researchers to rapidly explore novel machine learning architecture and data analysis algorithms.

Key facts. Cited by 110 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Jul 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 13; 2022: 21; 2023: 31; 2024: 27; 2025: 12; 2026: 6.

110 papers.

Sort:

By area:

  1. 2023Finding Neurons in a Haystack: Case Studies with Sparse Probingcited by 334
  2. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
  3. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
  4. 2023From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inferencecited by 170
  5. 2023Raising the Cost of Malicious AI-Powered Image Editingcited by 163
  6. 2024The Remarkable Robustness of LLMs: Stages of Inference?cited by 146
  7. 2024Universal Neurons in GPT2 Language Modelscited by 102
  8. 2024From Imitation to Refinement -- Residual RL for Precise Assemblycited by 90
  9. 2021Equivariant Contrastive Learningcited by 66
  10. 2021Subspace Regularizers for Few-Shot Class Incremental Learningcited by 56
  11. 2021Benchmarking the Performance of Bayesian Optimization across Multiple Experimental Materials Science Domainscited by 48
  12. 2024JUICER: Data-Efficient Imitation Learning for Robotic Assemblycited by 38
38 more
  1. 2022Scalable Multi-Agent Reinforcement Learning through Intelligent Information Aggregationcited by 36
  2. 2022A Data-Based Perspective on Transfer Learningcited by 32
  3. 2022Aspects of scaling and scalability for flow-based sampling of lattice QCDcited by 26
  4. 2022When does Bias Transfer in Transfer Learning?cited by 23
  5. 2022Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Modelscited by 21
  6. 2021Gauge Invariant and Anyonic Symmetric Transformer and RNN Quantum States for Quantum Lattice Modelscited by 18
  7. 2023Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbertcited by 18
  8. 2024Generalizing Denoising to Non-Equilibrium Structures Improves Equivariant Force Fieldscited by 18
  9. 2025BlendedNet: A Blended Wing Body Aircraft Dataset and Surrogate Model for Aerodynamic Predictionscited by 16
  10. 2021Sparse Plus Low Rank Matrix Decomposition: A Discrete Optimization Approachcited by 14
  11. 2022Fast Bayesian Optimization of Needle-in-a-Haystack Problems using Zooming Memory-Based Initialization (ZoMBI)cited by 14
  12. 2023Rethinking Backdoor Attackscited by 14
  13. 2023Ship-D: Ship Hull Dataset for Design Optimization using Machine Learningcited by 13
  14. 2025Empirical Analysis of Sim-and-Real Cotraining of Diffusion Policies for Planar Pushing from Pixelscited by 13
  15. 2024Align and Distill: Unifying and Improving Domain Adaptive Object Detectioncited by 12
  16. 2025Weighted quantization using MMD: From mean field to mean shift via gradient flowscited by 12
  17. 2023ShipGen: A Diffusion Model for Parametric Ship Hull Generation with Multiple Objectives and Constraintscited by 11
  18. 2023Synthetically generated text for supervised text analysiscited by 10
  19. 2024Sustainable Supercomputing for AI: GPU Power Capping at HPC Scalecited by 9
  20. 2025Learning to Dissipate Energy in Oscillatory State-Space Modelscited by 9
  21. 2022AER: Auto-Encoder with Regression for Time Series Anomaly Detectioncited by 8
  22. 2023ANTN: Bridging Autoregressive Neural Networks and Tensor Networks for Quantum Many-Body Simulationcited by 8
  23. 2024Multitask methods for predicting molecular properties from heterogeneous datacited by 8
  24. 2021The MIT Supercloud Datasetcited by 7
  25. 2022Benchmarking Resource Usage for Efficient Distributed Deep Learningcited by 7
  26. 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypointscited by 7
  27. 2023Robust Fine-Tuning of Vision-Language Models for Domain Generalizationcited by 7
  28. 2022Many processors, little time: MCMC for partitions via optimal transport couplingscited by 6
  29. 2023Improving Small Language Models on PubMedQA via Generative Data Augmentationcited by 6
  30. 2023DATED: Guidelines for Creating Synthetic Datasets for Engineering Design Applicationscited by 6
  31. 2023Temporal Transfer Learning for Traffic Optimization with Coarse-grained Advisory Autonomycited by 6
  32. 2024Practical applications of machine-learned flows on gauge fieldscited by 6
  33. 2025On the Origin of Algorithmic Progress in AIcited by 6
  34. 2023A Green(er) World for A.Icited by 5
  35. 2023On Statistical Properties of Sharpness-Aware Minimization: Provable Guaranteescited by 5
  36. 2023Sparse Gaussian Graphical Models with Discrete Optimization: Computational and Statistical Perspectivescited by 5
  37. 2024DreamSat: Towards a General 3D Model for Novel View Synthesis of Space Objectscited by 5
  38. 2024Cooperation and Fairness in Multi-Agent Reinforcement Learningcited by 5

50 most cited of 110 All 110 (JSON)