JAFAR: Jack up Any Feature at Any Resolution
Not on the map. Why?
Abstract (arXiv)
Foundation Vision Encoders have become essential for a wide range of dense vision tasks. However, their low-resolution spatial feature outputs necessitate feature upsampling to produce the high-resolution modalities required for downstream tasks. In this work, we introduce JAFAR, a lightweight and flexible feature upsampler that enhances the spatial resolution of visual features from any Foundation Vision Encoder to an arbitrary target resolution. JAFAR employs an attention-based module designed to promote semantic alignment between high-resolution queries, derived from low-level image features, and semantically enriched low-resolution keys, using Spatial Feature Transform (SFT) modulation. Notably, despite the absence of high-resolution supervision, we demonstrate that learning at low upsampling ratios and resolutions generalizes remarkably well to significantly higher output scales. Extensive experiments show that JAFAR effectively recovers fine-grained spatial details and consistently outperforms existing feature upsampling methods across a diverse set of downstream tasks. Project page at https://jafar-upsampler.github.io
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 45 of its 56 references that are in the map. First posted on arXiv 10 Jun 2025.
Builds on
45 of 56 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
33 more
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 371
- 2016A Learned Representation For Artistic Stylecited by 341
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
- 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
- 2019CARAFE: Content-Aware ReAssembly of FEaturescited by 119
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
- 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
- 2024DINO-Tracker: Taming DINO for Self-Supervised Point Tracking in a Single Videocited by 64
- 2023Learning to Upsample by Learning to Samplecited by 57
- 2024Denoising Vision Transformerscited by 40
- 2022SAPA: Similarity-Aware Point Affiliation for Feature Upsamplingcited by 32
- 2024LiFT: A Surprisingly Simple Lightweight Feature Transform for Dense ViT Descriptorscited by 27
- 2024DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cutcited by 26
- 2021Revisiting The Evaluation of Class Activation Mapping for Explainability: A Novel Metric and Experimental Analysiscited by 25
- 2022FADE: Fusing the Assets of Decoder and Encoder for Task-Agnostic Upsamplingcited by 25
- 2023Opti-CAM: Optimizing saliency maps for interpretabilitycited by 25
- 2023PointBeV: A Sparse Approach to BeV Predictionscited by 23
- 2025LoftUp: Learning a Coordinate-Based Feature Upsampler for Vision Foundation Modelscited by 23
- 2025Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Lightcited by 18
- 2025TULIP: Towards Unified Language-Image Pretrainingcited by 11
- 2024A Refreshed Similarity-based Upsampler for Direct High-Ratio Feature Upsamplingcited by 7
Built on by
Citing papers per year: 2025: 5; 2026: 16.
21 papers.
Sort:
- 2025AnyUp: Universal Feature Upsamplingcited by 28
- 2025Upsample Anything: A Simple and Hard to Beat Baseline for Feature Upsamplingcited by 6
- 2025NAF: Zero-Shot Feature Upsampling via Neighborhood Attention Filteringcited by 6
- 2025GaussianPlant: Structure-aligned Gaussian Splatting for 3D Reconstruction of Plantscited by 3
- 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
- 2026UPLiFT: Efficient Pixel-Dense Feature Upsampling with Local Attenderscited by 2
- 2026IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimensioncited by 2
- 2026Restoration Adaptation for Semantic Segmentation on Low Quality Imagescited by 1
- 2026Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopycited by 1
- 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagerycited by 1
- 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasoundcited by 1
- 2025Training-Free Out-Of-Distribution Segmentation With Foundation Modelscited by 0
9 more
- 2026Spectral Probing of Feature Upsamplers in 2D-to-3D Scene Reconstructioncited by 0
- 2026DiveUp: Learning Feature Upsampling from Diverse Vision Foundation Modelscited by 0
- 2026MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Modelscited by 0
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsamplingcited by 0
- 2026ViT-Up: Faithful Feature Upsampling for Vision Transformerscited by 0
- 2026RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representationcited by 0
- 2026From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentationcited by 0
- 2026Streaming Neural Speech Codecs through Time-Invariant Representationscited by 0
- 2026PixelUp: Zero-Shot Semantic Feature Upsampling for Fine-Grained Vision Taskscited by 0
- 2026PixelUp: Zero-Shot Semantic Feature Upsampling for Fine-Grained Vision Tasks3 Aug 2026
- 2026Streaming Neural Speech Codecs through Time-Invariant Representations6 Jul 2026
- 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasound1 Jul 2026
- 2026From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentation22 Jun 2026
- 2026RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representation22 Jun 2026
- 2026ViT-Up: Faithful Feature Upsampling for Vision Transformers12 Jun 2026
- 2026IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimension2 Jun 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagery4 May 2026
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling31 Mar 2026
- 2026MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Models26 Mar 2026
- 2026Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopy20 Mar 2026
9 more
- 2026DiveUp: Learning Feature Upsampling from Diverse Vision Foundation Models13 Mar 2026
- 2026Spectral Probing of Feature Upsamplers in 2D-to-3D Scene Reconstruction6 Mar 2026
- 2026Restoration Adaptation for Semantic Segmentation on Low Quality Images15 Feb 2026
- 2026UPLiFT: Efficient Pixel-Dense Feature Upsampling with Local Attenders25 Jan 2026
- 2025GaussianPlant: Structure-aligned Gaussian Splatting for 3D Reconstruction of Plants16 Dec 2025
- 2025NAF: Zero-Shot Feature Upsampling via Neighborhood Attention Filtering23 Nov 2025
- 2025Upsample Anything: A Simple and Hard to Beat Baseline for Feature Upsampling20 Nov 2025
- 2025AnyUp: Universal Feature Upsampling14 Oct 2025
- 2025Training-Free Out-Of-Distribution Segmentation With Foundation Models3 Oct 2025
- 2025AnyUp: Universal Feature Upsamplingcited by 28
- 2025Upsample Anything: A Simple and Hard to Beat Baseline for Feature Upsamplingcited by 6
- 2025NAF: Zero-Shot Feature Upsampling via Neighborhood Attention Filteringcited by 6
- 2025GaussianPlant: Structure-aligned Gaussian Splatting for 3D Reconstruction of Plantscited by 3
- 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
- 2026UPLiFT: Efficient Pixel-Dense Feature Upsampling with Local Attenderscited by 2
- 2026IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimensioncited by 2
- 2026Restoration Adaptation for Semantic Segmentation on Low Quality Imagescited by 1
- 2026Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopycited by 1
- 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagerycited by 1
- 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasoundcited by 1
- 2025Training-Free Out-Of-Distribution Segmentation With Foundation Modelscited by 0
12 most cited of 21 All 21 (JSON)
- 2026PixelUp: Zero-Shot Semantic Feature Upsampling for Fine-Grained Vision Tasks3 Aug 2026
- 2026Streaming Neural Speech Codecs through Time-Invariant Representations6 Jul 2026
- 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasound1 Jul 2026
- 2026From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentation22 Jun 2026
- 2026RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representation22 Jun 2026
- 2026ViT-Up: Faithful Feature Upsampling for Vision Transformers12 Jun 2026
- 2026IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimension2 Jun 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagery4 May 2026
- 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsampling31 Mar 2026
- 2026MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Models26 Mar 2026
- 2026Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopy20 Mar 2026
12 newest of 21 All 21 (JSON)