mlsanityData to 14 Oct 2026

Faynt: Scaling and Optimizing Policies for Competitive Melee

arXiv 2610.02144 ↗First posted 1 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce Faynt, a family of 10M- and 75M-parameter Transformer policies for Super Smash Bros. Melee, each controlling all 26 characters with a single checkpoint. After reinforcement learning (RL), the 10M wins 240 of 244 same-character games (98.4%) against fourteen specialist and multi-character releases on their supported rosters, with a winning record against every release. These opponents retain 21- or 24-frame action delays; Faynt uses no added delay, and we have not isolated the effect of this difference. In a separate evaluation against a privately supplied zero-delay Slippi-AI model, the 10M wins all 68 games across two conditioning settings. We study architecture, optimization, scaling, and hyperparameter transfer to guide pretraining on approximately 840,000 human replays. Post-training combines rank- and outcome-based curricula, 75M-to-10M distillation, and RL restricted to Fox mirror matches. On the initial 152-game benchmark, the supervised 10M wins 69.7% of games, compared with 45.4% for the pretrained 75M, despite higher overall held-out controller-prediction loss. The weighted validation loss used for supervised checkpoint selection agrees with the win-rate ordering of all four pretrained and supervised policies. After supervised post-training, both models take less damage per minute, build larger early leads, and win more often after losing the first life. Optimized inference on recorded game states averages 5.2 ms per decision for the 10M and 8.7 ms for the 75M on an NVIDIA T4, excluding emulator execution and communication. We open-source the weights, both benchmark suites, and a platform for automated model tournaments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

21 of 36 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  9. 2017Decoupled Weight Decay Regularizationcited by 1,831
  10. 2020GLU Variants Improve Transformercited by 1,804
  11. 2019Root Mean Square Layer Normalizationcited by 1,480
  12. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
9 more
  1. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  2. 2015Policy Distillationcited by 440
  3. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
  4. 2020Query-Key Normalization for Transformerscited by 280
  5. 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 72
  6. 2026Attention Residualscited by 65
  7. 2026Stream-Voice-Anon: Enhancing Utility of Real-Time Speaker Anonymization via Neural Audio Codec and Language Modelscited by 7
  8. 2017Beating the World's Best at Super Smash Bros. with Deep Reinforcement Learningcited by 3
  9. 2026Post-Grokking Collapse at the Representation-Readout Interface in Muon-Trained Transformerscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024FightLadder: A Benchmark for Competitive Multi-Agent Reinforcement Learning
  2. 2026Reinforcement Learning in Super Mario Bros: Curriculum, Pedagogy, and Optimal Level Design in World 1-1
  3. 2026Scaling Behavior Cloning Improves Causal Reasoning: An Open Model for Real-Time Video Game Playing
  4. 2025UBCL: A Reinforcement Learning Framework for Controllable and Diverse Player Behaviors
  5. 2022ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters
  6. 2026Learning in Dreams, Winning in Reality: A Continuous Dyna Loop for a Ten-Hero MOBA
  7. 2025Human-Level Competitive Pok'emon via Scalable Offline Reinforcement Learning with Transformers
  8. 2026Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-3