mlsanityData to 14 Oct 2026

JAFAR: Jack up Any Feature at Any Resolution

arXiv 2506.11136 ↗First posted 10 Jun 2025cs.CV eess.IVcited by 21

Not on the map. Why?

Abstract (arXiv)

Foundation Vision Encoders have become essential for a wide range of dense vision tasks. However, their low-resolution spatial feature outputs necessitate feature upsampling to produce the high-resolution modalities required for downstream tasks. In this work, we introduce JAFAR, a lightweight and flexible feature upsampler that enhances the spatial resolution of visual features from any Foundation Vision Encoder to an arbitrary target resolution. JAFAR employs an attention-based module designed to promote semantic alignment between high-resolution queries, derived from low-level image features, and semantically enriched low-resolution keys, using Spatial Feature Transform (SFT) modulation. Notably, despite the absence of high-resolution supervision, we demonstrate that learning at low upsampling ratios and resolutions generalizes remarkably well to significantly higher output scales. Extensive experiments show that JAFAR effectively recovers fine-grained spatial details and consistently outperforms existing feature upsampling methods across a diverse set of downstream tasks. Project page at https://jafar-upsampler.github.io

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 45 of its 56 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

45 of 56 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023Segment Anythingcited by 8,234
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  9. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  10. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  11. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  12. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
33 more
  1. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  2. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  3. 2021Vision Transformers for Dense Predictioncited by 1,803
  4. 2024Depth Anything V2cited by 1,422
  5. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  6. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
  7. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  8. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  9. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  10. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 864
  11. 2021Extract Free Dense Labels from CLIPcited by 583
  12. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 375
  13. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 371
  14. 2016A Learned Representation For Artistic Stylecited by 341
  15. 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
  16. 2022Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?cited by 128
  17. 2019CARAFE: Content-Aware ReAssembly of FEaturescited by 119
  18. 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
  19. 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
  20. 2024DINO-Tracker: Taming DINO for Self-Supervised Point Tracking in a Single Videocited by 64
  21. 2023Learning to Upsample by Learning to Samplecited by 57
  22. 2024Denoising Vision Transformerscited by 40
  23. 2022SAPA: Similarity-Aware Point Affiliation for Feature Upsamplingcited by 32
  24. 2024LiFT: A Surprisingly Simple Lightweight Feature Transform for Dense ViT Descriptorscited by 27
  25. 2024DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cutcited by 26
  26. 2021Revisiting The Evaluation of Class Activation Mapping for Explainability: A Novel Metric and Experimental Analysiscited by 25
  27. 2022FADE: Fusing the Assets of Decoder and Encoder for Task-Agnostic Upsamplingcited by 25
  28. 2023Opti-CAM: Optimizing saliency maps for interpretabilitycited by 25
  29. 2023PointBeV: A Sparse Approach to BeV Predictionscited by 23
  30. 2025LoftUp: Learning a Coordinate-Based Feature Upsampler for Vision Foundation Modelscited by 23
  31. 2025Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Lightcited by 18
  32. 2025TULIP: Towards Unified Language-Image Pretrainingcited by 11
  33. 2024A Refreshed Similarity-based Upsampler for Direct High-Ratio Feature Upsamplingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 16.

21 papers.

Sort:

  1. 2025AnyUp: Universal Feature Upsamplingcited by 28
  2. 2025Upsample Anything: A Simple and Hard to Beat Baseline for Feature Upsamplingcited by 6
  3. 2025NAF: Zero-Shot Feature Upsampling via Neighborhood Attention Filteringcited by 6
  4. 2025GaussianPlant: Structure-aligned Gaussian Splatting for 3D Reconstruction of Plantscited by 3
  5. 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
  6. 2026UPLiFT: Efficient Pixel-Dense Feature Upsampling with Local Attenderscited by 2
  7. 2026IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimensioncited by 2
  8. 2026Restoration Adaptation for Semantic Segmentation on Low Quality Imagescited by 1
  9. 2026Evaluating Vision Foundation Models for Pixel and Object Classification in Microscopycited by 1
  10. 2026DINO Soars: DINOv3 for Open-Vocabulary Semantic Segmentation of Remote Sensing Imagerycited by 1
  11. 2026Prototype Memory-Guided Training-Free Anomaly Classification and Localization in Prenatal Ultrasoundcited by 1
  12. 2025Training-Free Out-Of-Distribution Segmentation With Foundation Modelscited by 0
9 more
  1. 2026Spectral Probing of Feature Upsamplers in 2D-to-3D Scene Reconstructioncited by 0
  2. 2026DiveUp: Learning Feature Upsampling from Diverse Vision Foundation Modelscited by 0
  3. 2026MuRF: Unlocking the Multi-Scale Potential of Vision Foundation Modelscited by 0
  4. 2026Excite, Attend and Segment (EASe): Domain-Agnostic Fine-Grained Mask Discovery with Feature Calibration and Self-Supervised Upsamplingcited by 0
  5. 2026ViT-Up: Faithful Feature Upsampling for Vision Transformerscited by 0
  6. 2026RaysUp: Ultra-light Universal Feature Upsampling via Geometry-Aware Ray Representationcited by 0
  7. 2026From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentationcited by 0
  8. 2026Streaming Neural Speech Codecs through Time-Invariant Representationscited by 0
  9. 2026PixelUp: Zero-Shot Semantic Feature Upsampling for Fine-Grained Vision Taskscited by 0