SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completion
Not on the map. Why?
Abstract (arXiv)
Existing vector-sketch models treat recognition and generation as separate tasks, leaving a gap for streaming interfaces that must understand a drawing as it is being made. We present SketchMamba, a single causal sequence model that continuously classifies a sketch from any partial prefix while simultaneously generating its continuation. We achieve this by applying a dense per-step classification loss to a selective state-space backbone. Evaluated on a 58-class subset of the Quick, Draw! dataset, SketchMamba yields 94.93% final-step accuracy and a progressive-accuracy Area Under the Curve (AUC) of 0.706, crossing 90% of its final accuracy by the time 70% of the strokes are drawn. In a matched-budget comparison, the 1.55 million-parameter backbone ties a causal Transformer while outperforming recurrent and convolutional baselines. Ablations confirm that the dense supervision regime, rather than the architecture alone, drives the early-prediction capability. The results demonstrate that a single causal hidden state can unify progressive recognition and autoregressive generation without auxiliary encoders or task-specific branching.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 51 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
35 of 51 references.
References · 35
- 2017Attention Is All You Needcited by 60,361
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2022A ConvNet for the 2020scited by 3,579
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
23 more
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 803
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 613
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
- 2013Generating Sequences With Recurrent Neural Networkscited by 554
- 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
- 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
- 2017A Neural Representation of Sketch Drawingscited by 313
- 2019A Study of BFLOAT16 for Deep Learning Trainingcited by 232
- 2021Accounting for Variance in Machine Learning Benchmarkscited by 201
- 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
- 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
- 2020Sketchformer: Transformer-based Representation for Sketched Structurecited by 78
- 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
- 2020Creative Sketch Generationcited by 44
- 2020B'ezierSketch: A generative model for scalable vector sketchescited by 43
- 2020Sketch-BERT: Learning Sketch Bidirectional Encoder Representation from Transformers by Self-supervised Learning of Sketch Gestaltcited by 42
- 2018SketchMate: Deep Hashing for Million-Scale Human Sketch Retrievalcited by 35
- 2020CoSE: Compositional Stroke Embeddingscited by 26
- 2017Sketch-pix2seq: a Model to Generate Sketches of Multiple Categoriescited by 20
- 2021SketchLattice: Latticed Representation for Sketch Manipulationcited by 19
- 2021DoodleFormer: Creative Sketch Drawing with Transformerscited by 17
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025StrokeFusion: Vector Sketch Generation via Joint Stroke-UDF Encoding and Latent Sequence Diffusion
- 2025AutoSketch: VLM-assisted Style-Aware Vector Sketch Completion
- 2025SwiftSketch: A Diffusion Model for Image-to-Vector Sketch Generation
- 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Models
- 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priors
- 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Models
- 2024VQ-SGen: A Vector Quantized Stroke Representation for Creative Sketch Generation
- 2025Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch