Fast Segment Anything
Not on the map. Why?
Abstract (arXiv)
The recently proposed segment anything model (SAM) has made a significant influence in many computer vision tasks. It is becoming a foundation step for many high-level tasks, like image segmentation, image caption, and image editing. However, its huge computation costs prevent it from wider applications in industry scenarios. The computation mainly comes from the Transformer architecture at high-resolution inputs. In this paper, we propose a speed-up alternative method for this fundamental task with comparable performance. By reformulating the task as segments-generation and prompting, we find that a regular CNN detector with an instance segmentation branch can also accomplish this task well. Specifically, we convert this task to the well-studied instance segmentation task and directly train the existing instance segmentation method using only 1/50 of the SA-1B dataset published by SAM authors. With our method, we achieve a comparable performance with the SAM method at 50 times higher run-time speed. We give sufficient experimental results to demonstrate its effectiveness. The codes and demos will be released at https://github.com/CASIA-IVA-Lab/FastSAM.
Key facts. Cited by 290 papers in the map (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 21 Jun 2023.
Builds on
20 of 34 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015Fast R-CNNcited by 2,933
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2018Panoptic Segmentationcited by 802
8 more
- 2015Holistically-Nested Edge Detectioncited by 592
- 2019YOLACT: Real-time Instance Segmentationcited by 443
- 2021Learning Open-World Object Proposals without Learning to Classifycited by 109
- 2014Salient Object Detection: A Surveycited by 98
- 2015Learning to Segment Object Candidatescited by 79
- 2023Detecting Everything in the Open World: Towards Universal Object Detectioncited by 62
- 2020Learning Selective Mutual Attention and Contrast for RGB-D Saliency Detectioncited by 38
- 2022EDTER: Edge Detection with Transformercited by 36
Built on by
Citing papers per year: 2023: 31; 2024: 104; 2025: 87; 2026: 68.
290 papers.
Sort:
By area:
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2023Tracking Anything with Decoupled Video Segmentationcited by 197
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 117
- 2023SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understandingcited by 111
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 110
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
- 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Drivingcited by 89
- 2023CNOS: A Strong Baseline for CAD-based Novel Object Segmentationcited by 87
- 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 85
- 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 76
38 more
- 2024Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactivelycited by 75
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 65
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 65
- 2023FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation modelscited by 57
- 2023Adapting Segment Anything Model for Change Detection in HR Remote Sensing Imagescited by 56
- 2024Watermark Anything with Localized Messagescited by 53
- 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 51
- 2025Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigationcited by 51
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real Worldcited by 48
- 2023A New Learning Paradigm for Foundation Model-based Remote Sensing Change Detectioncited by 47
- 2024Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruningcited by 47
- 2024IRSAM: Advancing Segment Anything Model for Infrared Small Target Detectioncited by 46
- 2023MobileSAMv2: Faster Segment Anything to Everythingcited by 42
- 2024EmbodiedSAM: Online Segment Any 3D Thing in Real Timecited by 40
- 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
- 2024Segment Any Changecited by 35
- 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 34
- 2024PTQ4SAM: Post-Training Quantization for Segment Anythingcited by 32
- 2024SAGD: Boundary-Enhanced Segment Anything in 3D Gaussian via Gaussian Decompositioncited by 30
- 2024Hi-SAM: Marrying Segment Anything Model for Hierarchical Text Segmentationcited by 30
- 2024Moving Object Segmentation: All You Need Is SAM (and Flow)cited by 30
- 2024Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentationcited by 30
- 2023Follow Anything: Open-set detection, tracking, and following in real-timecited by 29
- 2024CAT-SAM: Conditional Tuning for Few-Shot Adaptation of Segment Anything Modelcited by 27
- 2024AIDE: An Automatic Data Engine for Object Detection in Autonomous Drivingcited by 26
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
- 2025Dynam3D: Dynamic Layered 3D Tokens Empower VLM for Vision-and-Language Navigationcited by 23
- 2024SuperGaussian: Repurposing Video Models for 3D Super Resolutioncited by 22
- 2023Text Augmented Spatial-aware Zero-shot Referring Image Segmentationcited by 21
- 2023Segment Change Model (SCM) for Unsupervised Change detection in VHR Remote Sensing Images: a Case Study of Buildingscited by 21
- 2024Subobject-level Image Tokenizationcited by 21
- 2024Efficient Track Anythingcited by 21
- 2025EdgeTAM: On-Device Track Anything Modelcited by 21
- 2025DynamicEarth: How Far are We from Open-Vocabulary Change Detection?cited by 21
- 2023SlimSAM: 0.1% Data Makes Segment Anything Slimcited by 20
- 2025SegDINO: An Efficient Design for Medical and Natural Image Segmentation with DINO-V3cited by 20
- 2023FoodSAM: Any Food Segmentationcited by 19
- 2024Revisit Anything: Visual Place Recognition via Image Segment Retrievalcited by 19
50 most cited of 290 All 290 (JSON)
- 2026Eye, Robot: Learning Expressive Gaze Dynamics via a VLM-Guided Transformer-VAE14 Oct 2026
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking25 Sep 2026
- 2026VLMs Can Describe, But Not Measure: Object-Centric Scene Understanding for Robotic Manipulation23 Sep 2026
- 2026SkipVLA: Skipping VLA Steps with Classical Planning for Fast Robot Manipulation17 Sep 2026
- 2026Selective Cotton Boll Localization for Robotic Harvesting: Evaluation of Deep Learning Vision Models Under Field Conditions17 Sep 2026
- 2026Evaluation of Vision-Language Models Across Diverse Coastal Environments9 Sep 2026
- 2026HeatTok: Enhancing Remote Sensing Image Understanding via Thermodiffusion-based Tokenization23 Aug 2026
- 2026The Coastline as a Structural Constraint: Harnessing Scene Geometry for Autonomous Surface Vessel Localization21 Aug 2026
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation15 Aug 2026
- 2026GESTO: Human-Centric Spatio-Temporal Memory for Reasoning in Dynamic Scenes11 Aug 2026
- 2026Prior-SG: Task and Prior Driven Region Segmentation for Scene Graphs in Arbitrarily-Structured Environments6 Aug 2026
38 more
- 2026Lean-SAM2: Target-Anchored Memory and Encoder Acceleration for SAM222 Jul 2026
- 2026MuViSeg: Multi-View Segment Correspondences from Dense Geometry Priors20 Jul 2026
- 2026MobileSAM2: Lightweight Segment Anything for Spatial Intelligence14 Jul 2026
- 2026REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation10 Jul 2026
- 2026TestMate: Test-Time Domain Adaptation Aided by Lightweight Vision Foundation Model4 Jul 2026
- 2026Segmenting, Fast and Slow: Real-Time Open-Vocabulary Video Instance Segmentation with Dual-Path Processing30 Jun 2026
- 2026MV-GEL: Language-Driven Multi-View Geometric Entity Localization on Meshes30 Jun 2026
- 2026Rethinking Foundation Model Collaboration: Enhancing Specialized Models through Proxy Task Reasoning30 Jun 2026
- 2026GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping29 Jun 2026
- 2026Agentic Collaborative Cognition for Zero-Shot 3D Understanding23 Jun 2026
- 2026Curvature-aware 3D length estimation of greenhouse cucumbers using RGB-D imaging and cubic spline arc-length integration21 Jun 2026
- 2026ReA-OVCD: Training-Free Open-Vocabulary Change Detection via Semantic-Spatial Reliability Assessment18 Jun 2026
- 2026XmoPipe: A Pipeline for Large-Scale In-the-Wild Human Motion Dataset Construction17 Jun 2026
- 2026Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines6 Jun 2026
- 2026PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps1 Jun 2026
- 2026ESAM++: Efficient Online 3D Perception on the Edge28 May 2026
- 2026Self-Supervised Online Robot-Agnostic Traversability Estimation for Open-World Environments27 May 2026
- 2026RoadGIE: Towards A Global-Scale Aerial Benchmark for Generalizable Interactive Road Extraction26 May 2026
- 2026InstructSAM: Segment Any Instance with Any Instructions25 May 2026
- 2026RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation25 May 2026
- 2026P2DNav: Panorama-to-Downview Reasoning for Zero-shot Vision-and-Language Navigation19 May 2026
- 2026TinySAM 2: Extreme Memory Compression for Efficient Track Anything Model18 May 2026
- 2026SparseSAM: Structured Sparsification of Activations in Segment Anything Models17 May 2026
- 2026FUS3DMaps: Scalable and Accurate Open-Vocabulary Semantic Mapping by 3D Fusion of Voxel- and Instance-Level Layers5 May 2026
- 2026LAGO: Language-Guided Adaptive Object-Region Focus for Zero-Shot Visual-Text Alignment4 May 2026
- 2026A Real-time Scale-robust Network for Glottis Segmentation in Nasal Transnasal Intubation30 Apr 2026
- 2026Semantic-Fast-SAM: Efficient Semantic Segmenter22 Apr 2026
- 2026GRAIL: Autonomous Concept Grounding for Neuro-Symbolic Reinforcement Learning18 Apr 2026
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer14 Apr 2026
- 2026H-SPAM: Hierarchical Superpixel Anything Model13 Apr 2026
- 2026Boxes2Pixels: Learning Defect Segmentation from Noisy SAM Masks13 Apr 2026
- 2026Weight Group-wise Post-Training Quantization for Medical Foundation Model9 Apr 2026
- 2026Dense Point-to-Mask Optimization with Reinforced Point Selection for Crowd Instance Segmentation2 Apr 2026
- 2026Progressive Prompt-Guided Cross-Modal Reasoning for Referring Image Segmentation30 Mar 2026
- 2026Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphs30 Mar 2026
- 2026LoD-Loc v3: Generalized Aerial Localization in Dense Cities using Instance Silhouette Alignment20 Mar 2026
- 2026Exclusivity-Guided Mask Learning for Semi-Supervised Crowd Instance Segmentation and Counting17 Mar 2026
- 2026Prompt-Driven Lightweight Foundation Model for Instance Segmentation-Based Fault Detection in Freight Trains13 Mar 2026
50 newest of 290 All 290 (JSON)
- 2023Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Drivingcited by 89
- 2024EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Modelcited by 65
- 2024Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Modelscited by 17
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splattingcited by 14
- 2024Vocabulary-free Image Classification and Semantic Segmentationcited by 8
- 2025UniChange: Unifying Change Detection with Multimodal Large Language Modelcited by 8
- 2024FM-Fusion: Instance-aware Semantic Mapping Boosted by Vision-Language Foundation Modelscited by 3
- 2026Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselinescited by 3
- 2024Every Part Matters: Integrity Verification of Scientific Figures Based on Multimodal Large Language Modelscited by 1
- 2025T-Rex: Task-Adaptive Spatial Representation Extraction for Robotic Manipulation with Vision-Language Modelscited by 1
- 2025Zero-Shot Peg Insertion: Identifying Mating Holes and Estimating SE(2) Poses with Vision-Language Modelscited by 0
- 2025DGL-RSIS: Decoupling Global Spatial Context and Local Class Semantics for Training-Free Remote Sensing Image Segmentationcited by 0
12 most cited of 16 All 16 (JSON)
- 2026Evaluation of Vision-Language Models Across Diverse Coastal Environments9 Sep 2026
- 2026HeatTok: Enhancing Remote Sensing Image Understanding via Thermodiffusion-based Tokenization23 Aug 2026
- 2026Agentic Collaborative Cognition for Zero-Shot 3D Understanding23 Jun 2026
- 2026Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines6 Jun 2026
- 2026PlatonicNav: Unveiling Semantic Correspondence in Navigation with Platonic Topological Maps1 Jun 2026
- 2025UniChange: Unifying Change Detection with Multimodal Large Language Model4 Nov 2025
- 2025DGL-RSIS: Decoupling Global Spatial Context and Local Class Semantics for Training-Free Remote Sensing Image Segmentation30 Aug 2025
- 2025T-Rex: Task-Adaptive Spatial Representation Extraction for Robotic Manipulation with Vision-Language Models24 Jun 2025
- 2025Zero-Shot Peg Insertion: Identifying Mating Holes and Estimating SE(2) Poses with Vision-Language Models8 Mar 2025
- 2025AutoOcc: Automatic Open-Ended Semantic Occupancy Annotation via Vision-Language Guided Gaussian Splatting7 Feb 2025
- 2024Img-Diff: Contrastive Data Synthesis for Multimodal Large Language Models8 Aug 2024
- 2024Every Part Matters: Integrity Verification of Scientific Figures Based on Multimodal Large Language Models26 Jul 2024
12 newest of 16 All 16 (JSON)
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 65
- 2024BlendRL: A Framework for Merging Symbolic and Neural Policy Learningcited by 14
- 2025VL-Nav: Neuro-Symbolic Reasoning-based Vision-Language Navigationcited by 4
- 2025AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoningcited by 4
- 2025Constructing and Interpreting Digital Twin Representations for Visual Reasoning via Reinforcement Learningcited by 1
- 2026Rethinking Foundation Model Collaboration: Enhancing Specialized Models through Proxy Task Reasoningcited by 1
- 2026VISOR: VIsual Spatial Object Reasoning for Language-driven Object Navigationcited by 0
- 2026Progressive Prompt-Guided Cross-Modal Reasoning for Referring Image Segmentationcited by 0
- 2026GRAIL: Autonomous Concept Grounding for Neuro-Symbolic Reinforcement Learningcited by 0
- 2026Prior-SG: Task and Prior Driven Region Segmentation for Scene Graphs in Arbitrarily-Structured Environmentscited by 0
- 2026Prior-SG: Task and Prior Driven Region Segmentation for Scene Graphs in Arbitrarily-Structured Environments6 Aug 2026
- 2026Rethinking Foundation Model Collaboration: Enhancing Specialized Models through Proxy Task Reasoning30 Jun 2026
- 2026GRAIL: Autonomous Concept Grounding for Neuro-Symbolic Reinforcement Learning18 Apr 2026
- 2026Progressive Prompt-Guided Cross-Modal Reasoning for Referring Image Segmentation30 Mar 2026
- 2026VISOR: VIsual Spatial Object Reasoning for Language-driven Object Navigation7 Feb 2026
- 2025Constructing and Interpreting Digital Twin Representations for Visual Reasoning via Reinforcement Learning15 Nov 2025
- 2025AIM-CoT: Active Information-driven Multimodal Chain-of-Thought for Vision-Language Reasoning30 Sep 2025
- 2025VL-Nav: Neuro-Symbolic Reasoning-based Vision-Language Navigation2 Feb 2025
- 2024BlendRL: A Framework for Merging Symbolic and Neural Policy Learning15 Oct 2024
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models22 May 2024
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real Worldcited by 48
- 2023Language-Conditioned Semantic Search-Based Policy for Robotic Manipulation Taskscited by 5
- 2024Robust Imitation Learning for Mobile Manipulator Focusing on Task-Related Viewpoints and Regionscited by 2
- 2026Flow-Enabled Generalization to Human Demonstrations in Few-Shot Imitation Learningcited by 0
- 2026Flow-Enabled Generalization to Human Demonstrations in Few-Shot Imitation Learning11 Feb 2026
- 2024Robust Imitation Learning for Mobile Manipulator Focusing on Task-Related Viewpoints and Regions2 Oct 2024
- 2023Language-Conditioned Semantic Search-Based Policy for Robotic Manipulation Tasks10 Dec 2023
- 2023SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World5 Dec 2023
- 2024AIDE: An Automatic Data Engine for Object Detection in Autonomous Drivingcited by 26
- 2026See Less, Drive Better: Generalizable End-to-End Autonomous Driving via Foundation Models Stochastic Patch Selectioncited by 4
- 2024Words to Wheels: Vision-Based Autonomous Driving Understanding Human Language Instructions Using Foundation Modelscited by 2
- 2026See Less, Drive Better: Generalizable End-to-End Autonomous Driving via Foundation Models Stochastic Patch Selection15 Jan 2026
- 2024Words to Wheels: Vision-Based Autonomous Driving Understanding Human Language Instructions Using Foundation Models14 Oct 2024
- 2024AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving26 Mar 2024
- 2025Better Decisions through the Right Causal World Modelcited by 3
- 2025Better Decisions through the Right Causal World Model9 Apr 2025
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2023Tracking Anything with Decoupled Video Segmentationcited by 197
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 117
- 2023SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understandingcited by 111
- 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 110
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
- 2023CNOS: A Strong Baseline for CAD-based Novel Object Segmentationcited by 87
- 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 85
- 2023Foundational Models in Medical Imaging: A Comprehensive Survey and Future Visioncited by 76
- 2024Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactivelycited by 75
12 most cited of 243 All 243 (JSON)
- 2026Eye, Robot: Learning Expressive Gaze Dynamics via a VLM-Guided Transformer-VAE14 Oct 2026
- 2026InterEvolve: Test-Time Evolution of Reward Programs for Humanoid Loco-Manipulation1 Oct 2026
- 2026TRACKGRAPH: Online Open-Vocabulary 3D Scene Graphs via Image-Space Tracking25 Sep 2026
- 2026VLMs Can Describe, But Not Measure: Object-Centric Scene Understanding for Robotic Manipulation23 Sep 2026
- 2026Selective Cotton Boll Localization for Robotic Harvesting: Evaluation of Deep Learning Vision Models Under Field Conditions17 Sep 2026
- 2026The Coastline as a Structural Constraint: Harnessing Scene Geometry for Autonomous Surface Vessel Localization21 Aug 2026
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation15 Aug 2026
- 2026GESTO: Human-Centric Spatio-Temporal Memory for Reasoning in Dynamic Scenes11 Aug 2026
- 2026Lean-SAM2: Target-Anchored Memory and Encoder Acceleration for SAM222 Jul 2026
- 2026MuViSeg: Multi-View Segment Correspondences from Dense Geometry Priors20 Jul 2026
- 2026REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation10 Jul 2026
- 2026TestMate: Test-Time Domain Adaptation Aided by Lightweight Vision Foundation Model4 Jul 2026
12 newest of 243 All 243 (JSON)