TuringViT: Making SOTA Vision Transformers Accessible to All
Not on the map. Why?
Abstract (arXiv)
Modern VLMs and VLA systems commonly adopt off-the-shelf ViTs such as SigLIP2 as visual encoders, but diverse downstream requirements in latency, temporal modeling, and VLM integration often call for customized SOTA-level ViTs. Training such encoders remains beyond the reach of much of the community, as it requires massive image-text data, while standard softmax attention makes high-resolution or dynamic-resolution pretraining prohibitively costly and often forces low-resolution pretraining followed by post-hoc adaptation. TuringViT addresses these challenges with three key designs: Turing Linear Attention (TLA) for efficient sequence modeling, VISTA-Curation to construct supervision-rich image-video training data, and native dynamic-resolution pretraining that supports flexible inputs from the start and transfers seamlessly to downstream VLMs. As a result, TuringViT outperforms leading open-source ViT baselines with only 10% of the data, achieves stronger downstream VLM performance, and delivers substantially better latency scaling on high-resolution inputs. Our scaling-law analysis further shows that TuringViT continues to improve predictably with curated data scale, far from saturation. Its fast adaptation, hardware-friendly design, and efficient deployment have made it a unified visual foundation across XPeng's AI systems. More broadly, TuringViT provides a reproducible pipeline that dramatically lowers the cost for the community to train, customize, and deploy SOTA-level ViTs, moving toward making such Vision Transformers accessible to all.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 69 of its 75 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
69 of 75 references.
References · 69
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
38 more
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2020GLU Variants Improve Transformercited by 1,804
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards VQA Models That Can Readcited by 1,718
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2020Rethinking Attention with Performerscited by 1,601
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2019Natural Adversarial Examplescited by 1,408
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2016Modeling Context in Referring Expressionscited by 1,063
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,013
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 940
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2023Gated Linear Attention Transformers with Hardware-Efficient Trainingcited by 514
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
- 2026Linearizing Vision Transformer with Test-Time Training
- 2025ViT3: Unlocking Test-Time Training in Vision
- 2026ViT-5: Vision Transformers for The Mid-2020s
- 2025Filter Images First, Generate Instructions Later: Pre-Instruction Data Selection for Visual Instruction Tuning
- 2024FastVLM: Efficient Vision Encoding for Vision Language Models
- 2026Penguin-VL: Exploring the Efficiency Limits of VLM with LLM-based Vision Encoders
- 2026VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision