Deformable DETR: Deformable Transformers for End-to-End Object Detection
Not on the map. Why?
Cited by 80 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
DETR has been recently proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance. However, it suffers from slow convergence and limited feature spatial resolution, due to the limitation of Transformer attention modules in processing image feature maps. To mitigate these issues, we proposed Deformable DETR, whose attention modules only attend to a small set of key sampling points around a reference. Deformable DETR can achieve better performance than DETR (especially on small objects) with 10 times less training epochs. Extensive experiments on the COCO benchmark demonstrate the effectiveness of our approach. Code is released at https://github.com/fundamentalvision/Deformable-DETR.
Key facts. Cited by 3,410 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 306; 2022: 624; 2023: 779; 2024: 721; 2025: 589; 2026: 391.
3,410 papers.
Sort:
By area:
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021Transformers in Vision: A Surveycited by 1,009
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
38 more
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021Domain Generalization: A Surveycited by 760
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2021Transformer in Transformercited by 632
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
- 2021Twins: Revisiting the Design of Spatial Attention in Vision Transformerscited by 565
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 499
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2021Conditional Positional Encodings for Vision Transformerscited by 402
- 2021A Survey of Transformerscited by 399
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2021Rethinking Spatial Dimensions of Vision Transformerscited by 361
- 2022Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizationscited by 359
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
50 most cited of 3,410 All 3,410 (JSON)
- 2026LiG-DETR: Local-in-Global Reassembly in Latent Space for Aerial Object Detection7 Oct 2026
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026HEIR: Learning Human-Entity Interactions with Functional Roles28 Sep 2026
- 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection26 Sep 2026
- 2026S2Planner: Multi-Scale Semantic Planner for End-to-End Autonomous Driving24 Sep 2026
- 2026AgriCountDINO: Parameter-Efficient Exemplar-Guided Counting and Localization in Agriculture24 Sep 2026
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting23 Sep 2026
- 2026From Alignment to Fusion in 3D Vision-Language23 Sep 2026
- 2026TEEP-RCNN: Texture-Enhanced Edge-aware Perception for Steel Surface Defect Detection via Improved Convolutional Block Attention in Faster R-CNN23 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Grounding21 Sep 2026
- 2026HOIBlender: Blending Lightweight Detection with Vision-Language Priors for Efficient Human-Object Interaction Detection20 Sep 2026
38 more
- 2026HDMamba-YOLO: Efficient State-Space Perception and Local Spatial Reconstruction for UAV Small Object19 Sep 2026
- 2026A benchmark dataset and baseline methods for four-dimensional STEM diffraction patterns18 Sep 2026
- 2026Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement17 Sep 2026
- 2026Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries16 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026End-to-End Cell Detection via Instance-aware Graph Modeling14 Sep 2026
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026Bi-Level Routing and Sparse Spatial Attention based Multi-View BEV 3D Object Detection for Autonomous Driving12 Sep 2026
- 2026Degraded but Not Entirely Ineffective: PE-Based Deformable Graph Neural Networks12 Sep 2026
- 2026YOLO12-MambaScan: An Efficient Object Detector with High-Frequency Enhancement and State-Space Modeling12 Sep 2026
- 2026DERA: Detached Edge-Residual Adaptation for Prohibited item Detection11 Sep 2026
- 2026GSO-Net: Visual State Machines for Hazardous Freight Transfer Compliance at Petrochemical Logistics Nodes11 Sep 2026
- 2026HGSQ: Heatmap-Guided Sparse Query Detector for Real-Time Aerial Small Object Detection10 Sep 2026
- 2026Single-Query Person-Centric Bimanual Hand-Object Interaction Detection10 Sep 2026
- 2026ScopeMamba-YOLO: Widening the Perceptual Scope Inward and Outward for Small Object Detection in Remote Sensing Imagery9 Sep 2026
- 2026CLFTv2: Efficient Camera-LiDAR Fusion for Semantic Segmentation via Hierarchical Feature Pyramids9 Sep 2026
- 2026Hyperbolic Geometry for Open-World Object Detection in Remote Sensing Imagery9 Sep 2026
- 2026SAM3-O2D2: Zero-Shot Object Out-of-Distribution Detection by Object Class Prompting of the SAM3-Image Model8 Sep 2026
- 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spotting7 Sep 2026
- 2026Reading Decoder Trajectories: Training-Free Counterfactual Query-Trajectory Reliability for Small-Object Detection6 Sep 2026
- 2026UniGIO: Unified Generative Global In-situ Weather Modeling from Spatiotemporal Incomplete Observations2 Sep 2026
- 2026CoViT: Instance-Correspondence Contrastive Learning for Vision Transformer1 Sep 2026
- 2026Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking1 Sep 2026
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving31 Aug 2026
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation31 Aug 2026
- 2026RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation31 Aug 2026
- 2026AQ3D: Adaptive Query Transformer for 3D Instance Segmentation31 Aug 2026
- 2026Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection31 Aug 2026
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Hyper-Fold: Exploring the Expressive Limit of Sequence-Geometry Learning for Proteins via Hypergraph Modeling29 Aug 2026
- 2026RLG-TPV: Radar- and LiDAR-Guided Tri-Perspective View Fusion for Camera-Radar 3D Object Detection29 Aug 2026
- 2026OPUS-V2: Bridging the Gap between Sparse Points and Dense Voxels29 Aug 2026
- 2026Cut-ViT: Task-Specific Model Pruning via Gram Anchoring Subspace Consistency28 Aug 2026
- 2026A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection28 Aug 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026Variable-Granularity Tokenization for High-Resolution Object Detection27 Aug 2026
- 2026State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models27 Aug 2026
50 newest of 3,410 All 3,410 (JSON)
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 255
- 2023Honeybee: Locality-enhanced Projector for Multimodal LLMcited by 195
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
- 2024Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoderscited by 137
- 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
- 2023Aligning Bag of Regions for Open-Vocabulary Object Detectioncited by 119
- 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 118
- 2023Contextual Object Detection with Multimodal Large Language Modelscited by 100
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2024DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Modelscited by 74
- 2021Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-trainingcited by 67
12 most cited of 67 All 67 (JSON)
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting23 Sep 2026
- 2026Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving31 Aug 2026
- 2026State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models27 Aug 2026
- 2026Visual Distortion Detection in UGC Images Using Large Multimodal Models10 Aug 2026
- 2026From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models24 Jun 2026
- 2026VL-DINO: Leveraging CLIP Vision-Language Knowledge for Open-Vocabulary Object Detectio10 Jun 2026
- 2026FlowOVD: Learning Generative Latent Flows for Zero-shot Open-vocabulary Detection30 May 2026
- 2026GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detection28 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026OneDrive: Unified Multi-Paradigm Driving with Vision-Language-Action Models20 Apr 2026
- 2026LED: A Benchmark for Evaluating Layout Error Detection in Document Analysis18 Mar 2026
- 2026AppleVLM: End-to-end Autonomous Driving with Advanced Perception and Planning-Enhanced Vision-Language Models4 Feb 2026
12 newest of 67 All 67 (JSON)
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2024DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Drivingcited by 324
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2024ImageFolder: Autoregressive Image Generation with Folded Tokenscited by 93
- 2024Deep Reward Supervisions for Tuning Text-to-Image Diffusion Modelscited by 59
- 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
- 2024SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detectioncited by 42
- 2023DiffusionTrack: Diffusion Model For Multi-Object Trackingcited by 40
- 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 36
- 2023ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Modelscited by 31
12 most cited of 50 All 50 (JSON)
- 2026MegaSlide-DiT: Memory-Centric Adaptation and Deformable Local Attention for Efficient Video Diffusion17 Jul 2026
- 2026UniTeD: Unified Temporal Diffusion for Joint Perception and Planning in Autonomous Driving24 Jun 2026
- 2026BEV-Denoise: Learning Intrinsic Noise for Accurate Bird's-Eye-View Semantic Segmentation22 Jun 2026
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Accelerating Text-to-Video Generation with Calibrated Sparse Attention5 Mar 2026
- 2026Adaptive 1D Video Diffusion Autoencoder4 Feb 2026
- 2025FlowDet: Unifying Object Detection and Generative Transport Flows18 Dec 2025
- 2025ReCon: Region-Controllable Data Augmentation with Rectification and Alignment for Object Detection17 Oct 2025
- 2025Deforming Videos to Masks: Flow Matching for Referring Video Segmentation7 Oct 2025
- 2025Learning 3D Texture-Aware Representations for Parsing Diverse Human Clothing and Body Parts8 Aug 2025
- 2025Diff2I2P: Differentiable Image-to-Point Cloud Registration with Diffusion Prior9 Jul 2025
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
12 newest of 50 All 50 (JSON)
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 613
- 2023Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Drivingcited by 168
- 2023LaneSegNet: Map Learning with Lane Segment Perception for Autonomous Drivingcited by 57
- 2023Graph-based Topology Reasoning for Driving Scenescited by 53
- 2024SparseAD: Sparse Query-Centric Paradigm for Efficient End-to-End Autonomous Drivingcited by 46
- 2025iPad: Iterative Proposal-centric End-to-End Autonomous Drivingcited by 41
- 2023PPAD: Iterative Interactions of Prediction and Planning for End-to-end Autonomous Drivingcited by 33
- 2023Implicit Occupancy Flow Fields for Perception and Prediction in Self-Drivingcited by 30
- 2023Grid-Centric Traffic Scenario Perception for Autonomous Driving: A Comprehensive Reviewcited by 25
- 2024EchoTrack: Auditory Referring Multi-Object Tracking for Autonomous Drivingcited by 18
- 2024DualAD: Disentangling the Dynamic and Static World for End-to-End Drivingcited by 17
- 2024DeepInteraction++: Multi-Modality Interaction for Autonomous Drivingcited by 15
12 most cited of 33 All 33 (JSON)
- 2026S2Planner: Multi-Scale Semantic Planner for End-to-End Autonomous Driving24 Sep 2026
- 2026A Reliable Context-Aware and Temporal Planning Framework for Autonomous Driving6 Jul 2026
- 2026GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving15 Jun 2026
- 2026HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving4 Apr 2026
- 2026What Matters for Scalable and Robust Learning in End-to-End Driving Planners?16 Mar 2026
- 2026SafeDrive: Fine-Grained Safety Reasoning for End-to-End Driving in a Sparse World21 Feb 2026
- 2025Pseudo-Expert Regularized Offline RL for End-to-End Autonomous Driving in Photorealistic Closed-Loop Environments21 Dec 2025
- 2025Decoupling Scene Perception and Ego Status: A Multi-Context Fusion Approach for Enhanced Generalization in End-to-End Autonomous Driving17 Nov 2025
- 2025Foundation Models for Trajectory Planning in Autonomous Driving: A Review of Progress and Open Challenges31 Oct 2025
- 2025SynAD: Enhancing Real-World End-to-End Autonomous Driving Models through Synthetic Data Integration28 Oct 2025
- 2025Decoupled Functional Evaluation of Autonomous Driving Models via Feature Map Quality Scoring11 Aug 2025
- 2025DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Model7 Aug 2025
12 newest of 33 All 33 (JSON)
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 106
- 2024Mamba YOLO: A Simple Baseline for Object Detection with State Space Modelcited by 17
- 2024GroupMamba: Efficient Group-Based Visual State Space Modelcited by 15
- 2025AVS-Mamba: Exploring Temporal and Multi-modal Mamba for Audio-Visual Segmentationcited by 15
- 2024CFMW: Cross-modality Fusion Mamba for Robust Object Detection under Adverse Weathercited by 8
- 2024Deformable Mamba for Wide Field of View Segmentationcited by 7
- 2024A Hybrid Transformer-Mamba Network for Single Image Derainingcited by 6
- 2024QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 2024cited by 4
- 2024Mamba-YOLO-World: Marrying YOLO-World with Mamba for Open-Vocabulary Detectioncited by 3
- 2024RAWMamba: Unified sRGB-to-RAW De-rendering With State Space Modelcited by 3
- 2025DeflareMamba: Hierarchical Vision Mamba for Contextually Consistent Lens Flare Removalcited by 2
12 most cited of 28 All 28 (JSON)
- 2026SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognition30 Jun 2026
- 2026MambaDSF: Multi-Scale SSM with Dilated Feature Fusion for Sonar Small Target Detection24 May 2026
- 2026Beyond Mamba: Enhancing State-space Models with Deformable Dilated Convolutions for Multi-scale Traffic Object Detection9 Apr 2026
- 2025CellMamba: Adaptive Mamba for Accurate and Efficient Cell Detection25 Dec 2025
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2025DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactions2 Dec 2025
- 2025ReactionMamba: Generating Short & Long Human Reaction Sequences28 Nov 2025
- 2025WaveSeg: Enhancing Segmentation Precision via High-Frequency Prior and Mamba-Driven Spectrum Decomposition24 Oct 2025
- 2025CETUS: Causal Event-Driven Temporal Modeling With Unified Variable-Rate Scheduling17 Sep 2025
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection28 Aug 2025
- 2025DeflareMamba: Hierarchical Vision Mamba for Contextually Consistent Lens Flare Removal4 Aug 2025
- 2025Spatial-Temporal-Spectral Mamba with Sparse Deformable Token Sequence for Enhanced MODIS Time Series Classification29 Jul 2025
12 newest of 28 All 28 (JSON)
- 2023DetGPT: Detect What You Need via Reasoningcited by 112
- 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Modelscited by 65
- 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 22
- 2024From the Least to the Most: Building a Plug-and-Play Visual Reasoner via Data Synthesiscited by 17
- 2025Topo2Seq: Enhanced Topology Reasoning via Topology Sequence Learningcited by 9
- 2025FEALLM: Advancing Facial Emotion Analysis in Multimodal Large Language Models with Emotional Synergy and Reasoningcited by 5
- 2025From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors via LLM-guided Symbolic Reasoningcited by 3
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2022Dense but Efficient VideoQA for Intricate Compositional Reasoningcited by 2
- 2025Rethinking Visual Information Processing in Multimodal LLMscited by 2
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMscited by 2
12 most cited of 22 All 22 (JSON)
- 2026SupGRPO: Enhancing GRPO with Matching-based Online SFT for Text Spotting7 Sep 2026
- 2026CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation31 Aug 2026
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding27 Jul 2026
- 2026PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving6 Jul 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoning28 May 2026
- 2026SignReasoner: Compositional Reasoning for Complex Traffic Sign Understanding via Functional Structure Units12 Apr 2026
- 2026OpenQlaw: An Agentic AI Assistant for Analysis of 2D Quantum Materials17 Mar 2026
- 2026SPARROW: Learning Spatial Precision and Temporal Referential Consistency in Pixel-Grounded Video MLLMs12 Mar 2026
- 2026Focus on What Really Matters in Low-Altitude Governance: A Management-Centric Multi-Modal Benchmark with Implicitly Coordinated Vision-Language Reasoning Framework27 Jan 2026
- 2025Rethinking Visual Information Processing in Multimodal LLMs13 Nov 2025
- 2025What "Not" to Detect: Negation-Aware VLMs via Structured Reasoning and Token Merging15 Oct 2025
12 newest of 22 All 22 (JSON)
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2023Visual Point Cloud Forecasting enables Scalable Autonomous Drivingcited by 97
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecastingcited by 40
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Drivingcited by 28
- 2025DriveX: Omni Scene Modeling for Learning Generalizable World Knowledge in Autonomous Drivingcited by 20
- 2024BEVWorld: A Multimodal World Simulator for Autonomous Driving via Scene-Level BEV Latentscited by 19
- 2025I2-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecastingcited by 8
12 most cited of 14 All 14 (JSON)
- 2026DynaVieW: Schema-Guided World Modeling for Understanding Hierarchical Visual Dynamics5 Jul 2026
- 2025I2-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting12 Jul 2025
- 2025DriveX: Omni Scene Modeling for Learning Generalizable World Knowledge in Autonomous Driving25 May 2025
- 2025SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World Model18 Mar 2025
- 2024BEVWorld: A Multimodal World Simulator for Autonomous Driving via Scene-Level BEV Latents8 Jul 2024
- 2024UnO: Unsupervised Occupancy Fields for Perception and Forecasting12 Jun 2024
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond6 May 2024
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Driving23 Apr 2024
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb 2024
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks25 Jan 2024
- 2023Visual Point Cloud Forecasting enables Scalable Autonomous Driving29 Dec 2023
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinement27 Sep 2022
12 newest of 14 All 14 (JSON)
- 2021Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformercited by 175
- 2023DiffRate : Differentiable Compression Rate for Efficient Vision Transformerscited by 78
- 2023Dynamic Token Pruning in Plain Vision Transformers for Semantic Segmentationcited by 61
- 2023Revisiting Token Pruning for Object Detection and Instance Segmentationcited by 50
- 2022HeatViT: Hardware-Efficient Adaptive Token Pruning for Vision Transformerscited by 46
- 2023PPT: Token Pruning and Pooling for Efficient Vision Transformerscited by 37
- 2022Adaptive Sparse ViT: Towards Learnable Adaptive Token Pruning by Fully Exploiting Self-Attentioncited by 35
- 2023CAIT: Triple-Win Compression towards High Accuracy, Fast Inference, and Favorable Transferability For ViTscited by 9
- 2024Efficient Visual Transformer by Learnable Token Mergingcited by 7
- 2025Representation Shift: Unifying Token Compression with FlashAttentioncited by 5
- 2024Token Pruning using a Lightweight Background Aware Vision Transformercited by 3
- 2023Bridging The Gaps Between Token Pruning and Full Pre-training via Masked Fine-tuningcited by 0
12 most cited of 13 All 13 (JSON)
- 2025Representation Shift: Unifying Token Compression with FlashAttention1 Aug 2025
- 2024Token Pruning using a Lightweight Background Aware Vision Transformer12 Oct 2024
- 2024Efficient Visual Transformer by Learnable Token Merging21 Jul 2024
- 2024Arena: A Patch-of-Interest ViT Inference Acceleration System for Edge-Assisted Video Analytics14 Apr 2024
- 2023Bridging The Gaps Between Token Pruning and Full Pre-training via Masked Fine-tuning26 Oct 2023
- 2023PPT: Token Pruning and Pooling for Efficient Vision Transformers3 Oct 2023
- 2023CAIT: Triple-Win Compression towards High Accuracy, Fast Inference, and Favorable Transferability For ViTs27 Sep 2023
- 2023Dynamic Token Pruning in Plain Vision Transformers for Semantic Segmentation2 Aug 2023
- 2023Revisiting Token Pruning for Object Detection and Instance Segmentation12 Jun 2023
- 2023DiffRate : Differentiable Compression Rate for Efficient Vision Transformers29 May 2023
- 2022HeatViT: Hardware-Efficient Adaptive Token Pruning for Vision Transformers15 Nov 2022
- 2022Adaptive Sparse ViT: Towards Learnable Adaptive Token Pruning by Fully Exploiting Self-Attention28 Sep 2022
12 newest of 13 All 13 (JSON)
- 2024Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Datasetcited by 25
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detectioncited by 17
- 2025Mixture of Experts in Large Language Modelscited by 15
- 2025Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Expertscited by 9
- 2026HI-MoE: Hierarchical Instance-Conditioned Mixture-of-Experts for Object Detectioncited by 3
- 2024Mr. DETR++: Instructive Multi-Route Training for Detection Transformers with Mixture-of-Expertscited by 1
- 2025Bridging the Scale Gap: Balanced Tiny and General Object Detection in Remote Sensing Imagerycited by 1
- 2026Mixture-of-Top-k Attention: Efficient Attention via Scalable Fast Weightscited by 1
- 2026SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inferencecited by 1
- 2022Diversified Dynamic Routing for Vision Taskscited by 0
- 2026ExFusion: Efficient Transformer Training via Multi-Experts Fusioncited by 0
- 2026SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inference1 Jul 2026
- 2026HI-MoE: Hierarchical Instance-Conditioned Mixture-of-Experts for Object Detection6 Apr 2026
- 2026ExFusion: Efficient Transformer Training via Multi-Experts Fusion30 Mar 2026
- 2026Mixture-of-Top-k Attention: Efficient Attention via Scalable Fast Weights1 Feb 2026
- 2025Bridging the Scale Gap: Balanced Tiny and General Object Detection in Remote Sensing Imagery1 Dec 2025
- 2025Controllable-LPMoE: Adapting to Challenging Object Segmentation via Dynamic Local Priors from Mixture-of-Experts24 Oct 2025
- 2025Mixture of Experts in Large Language Models15 Jul 2025
- 2024Mr. DETR++: Instructive Multi-Route Training for Detection Transformers with Mixture-of-Experts13 Dec 2024
- 2024Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Dataset9 Dec 2024
- 2023MoCaE: Mixture of Calibrated Experts Significantly Improves Object Detection26 Sep 2023
- 2022Diversified Dynamic Routing for Vision Tasks26 Sep 2022
- 2024GUI Agents: A Surveycited by 101
- 2024RH20T-P: A Primitive-Level Robotic Dataset Towards Composable Generalization Agentscited by 20
- 2024GUI Agents: A Survey18 Dec 2024
- 2024RH20T-P: A Primitive-Level Robotic Dataset Towards Composable Generalization Agents28 Mar 2024
- 2023Recurrent Action Transformer with Memorycited by 17
- 2023Recurrent Action Transformer with Memory15 Jun 2023
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2021Transformers in Vision: A Surveycited by 1,009
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
12 most cited of 3,159 All 3,159 (JSON)
- 2026LiG-DETR: Local-in-Global Reassembly in Latent Space for Aerial Object Detection7 Oct 2026
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026HEIR: Learning Human-Entity Interactions with Functional Roles28 Sep 2026
- 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detection26 Sep 2026
- 2026AgriCountDINO: Parameter-Efficient Exemplar-Guided Counting and Localization in Agriculture24 Sep 2026
- 2026From Alignment to Fusion in 3D Vision-Language23 Sep 2026
- 2026TEEP-RCNN: Texture-Enhanced Edge-aware Perception for Steel Surface Defect Detection via Improved Convolutional Block Attention in Faster R-CNN23 Sep 2026
- 2026GTR: Gated Token Recurrence for Efficient Dense Prediction22 Sep 2026
- 2026DeCo: Efficient Decouple-to-Couple Learning for Multi-Task Visual Grounding21 Sep 2026
- 2026HOIBlender: Blending Lightweight Detection with Vision-Language Priors for Efficient Human-Object Interaction Detection20 Sep 2026
- 2026HDMamba-YOLO: Efficient State-Space Perception and Local Spatial Reconstruction for UAV Small Object19 Sep 2026
- 2026A benchmark dataset and baseline methods for four-dimensional STEM diffraction patterns18 Sep 2026
12 newest of 3,159 All 3,159 (JSON)