mlsanityData to 14 Oct 2026

TuringViT: Making SOTA Vision Transformers Accessible to All

arXiv 2606.24253 ↗First posted 23 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Modern VLMs and VLA systems commonly adopt off-the-shelf ViTs such as SigLIP2 as visual encoders, but diverse downstream requirements in latency, temporal modeling, and VLM integration often call for customized SOTA-level ViTs. Training such encoders remains beyond the reach of much of the community, as it requires massive image-text data, while standard softmax attention makes high-resolution or dynamic-resolution pretraining prohibitively costly and often forces low-resolution pretraining followed by post-hoc adaptation. TuringViT addresses these challenges with three key designs: Turing Linear Attention (TLA) for efficient sequence modeling, VISTA-Curation to construct supervision-rich image-video training data, and native dynamic-resolution pretraining that supports flexible inputs from the start and transfers seamlessly to downstream VLMs. As a result, TuringViT outperforms leading open-source ViT baselines with only 10% of the data, achieves stronger downstream VLM performance, and delivers substantially better latency scaling on high-resolution inputs. Our scaling-law analysis further shows that TuringViT continues to improve predictably with curated data scale, far from saturation. Its fast adaptation, hardware-friendly design, and efficient deployment have made it a unified visual foundation across XPeng's AI systems. More broadly, TuringViT provides a reproducible pipeline that dramatically lowers the cost for the community to train, customize, and deploy SOTA-level ViTs, moving toward making such Vision Transformers accessible to all.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 69 of its 75 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

69 of 75 references.

References · 69

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2024Qwen2.5 Technical Reportcited by 4,942
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  9. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  11. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  12. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
38 more
  1. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  2. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  3. 2017The Kinetics Human Action Video Datasetcited by 1,909
  4. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  5. 2020GLU Variants Improve Transformercited by 1,804
  6. 2021Vision Transformers for Dense Predictioncited by 1,803
  7. 2019Towards VQA Models That Can Readcited by 1,718
  8. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  9. 2020Rethinking Attention with Performerscited by 1,601
  10. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
  11. 2019Root Mean Square Layer Normalizationcited by 1,480
  12. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  13. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  14. 2019Natural Adversarial Examplescited by 1,408
  15. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  16. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  17. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  18. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
  19. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  20. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  21. 2016Modeling Context in Referring Expressionscited by 1,063
  22. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,013
  23. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
  24. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  25. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
  26. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  27. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
  28. 2016A Diagram Is Worth A Dozen Imagescited by 804
  29. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  30. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  31. 2023DataComp: In search of the next generation of multimodal datasetscited by 644
  32. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  33. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  34. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  35. 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
  36. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  37. 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
  38. 2023EVA-02: A Visual Representation for Neon Genesiscited by 381

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
  2. 2026Linearizing Vision Transformer with Test-Time Training
  3. 2025ViT3: Unlocking Test-Time Training in Vision
  4. 2026ViT-5: Vision Transformers for The Mid-2020s
  5. 2025Filter Images First, Generate Instructions Later: Pre-Instruction Data Selection for Visual Instruction Tuning
  6. 2024FastVLM: Efficient Vision Encoding for Vision Language Models
  7. 2026Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders
  8. 2026VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision