mlsanityData to 14 Oct 2026

SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completion

arXiv 2607.23580 ↗First posted 26 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing vector-sketch models treat recognition and generation as separate tasks, leaving a gap for streaming interfaces that must understand a drawing as it is being made. We present SketchMamba, a single causal sequence model that continuously classifies a sketch from any partial prefix while simultaneously generating its continuation. We achieve this by applying a dense per-step classification loss to a selective state-space backbone. Evaluated on a 58-class subset of the Quick, Draw! dataset, SketchMamba yields 94.93% final-step accuracy and a progressive-accuracy Area Under the Curve (AUC) of 0.706, crossing 90% of its final accuracy by the time 70% of the strokes are drawn. In a matched-budget comparison, the 1.55 million-parameter backbone ties a causal Transformer while outperforming recurrent and convolutional baselines. Ablations confirm that the dense supervision regime, rather than the architecture alone, drives the early-prediction capability. The results demonstrate that a single causal hidden state can unify progressive recognition and autoregressive generation without auxiliary encoders or task-specific branching.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 26 Jul 2026.

Builds on

35 of 51 references.

References · 35

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2022A ConvNet for the 2020scited by 3,579
  5. 2020Longformer: The Long-Document Transformercited by 3,413
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  7. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  8. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
  9. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  10. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  11. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  12. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
23 more
  1. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  2. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
  3. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  4. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
  5. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  6. 2013Generating Sequences With Recurrent Neural Networkscited by 554
  7. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
  8. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  9. 2017A Neural Representation of Sketch Drawingscited by 313
  10. 2019A Study of BFLOAT16 for Deep Learning Trainingcited by 232
  11. 2021Accounting for Variance in Machine Learning Benchmarkscited by 201
  12. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
  13. 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
  14. 2020Sketchformer: Transformer-based Representation for Sketched Structurecited by 78
  15. 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
  16. 2020Creative Sketch Generationcited by 44
  17. 2020B'ezierSketch: A generative model for scalable vector sketchescited by 43
  18. 2020Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestaltcited by 42
  19. 2018SketchMate: Deep Hashing for Million-Scale Human Sketch Retrievalcited by 35
  20. 2020CoSE: Compositional Stroke Embeddingscited by 26
  21. 2017Sketch-pix2seq: a Model to Generate Sketches of Multiple Categoriescited by 20
  22. 2021SketchLattice: Latticed Representation for Sketch Manipulationcited by 19
  23. 2021DoodleFormer: Creative Sketch Drawing with Transformerscited by 17

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025StrokeFusion: Vector Sketch Generation via Joint Stroke-UDF Encoding and Latent Sequence Diffusion
  2. 2025AutoSketch: VLM-assisted Style-Aware Vector Sketch Completion
  3. 2025SwiftSketch: A Diffusion Model for Image-to-Vector Sketch Generation
  4. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Models
  5. 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priors
  6. 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Models
  7. 2024VQ-SGen: A Vector Quantized Stroke Representation for Creative Sketch Generation
  8. 2025Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch