mlsanityData to 14 Oct 2026

Falcon Perception

arXiv 2603.27365 ↗First posted 28 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Perception-centric systems are typically implemented with a modular encoder-decoder pipeline: a vision backbone for feature extraction and a separate decoder (or late-fusion module) for task prediction. This raises a central question: is this architectural separation essential or can a single early-fusion stack do both perception and task modeling at scale? We introduce Falcon Perception, a unified dense Transformer that processes image patches and text tokens in a shared parameter space from the first layer, using a hybrid attention pattern (bidirectional among image tokens, causal for prediction tokens) to combine global visual context with autoregressive, variable-length instance generation. To keep dense outputs practical, Falcon Perception retains a lightweight token interface and decodes continuous spatial outputs with specialized heads, enabling parallel high-resolution mask prediction. Our design promotes simplicity: we keep a single scalable backbone and shift complexity toward data and training signals, adding only small heads where outputs are continuous and dense. On SA-Co, Falcon Perception improves mask quality to 68.0 Macro-F1 compared to 62.3 of SAM3. We also introduce PBench, a benchmark targeting compositional prompts (OCR, spatial constraints, relations) and dense long-context regimes, where the model shows better gains. Finally, we extend the same early-fusion recipe to Falcon OCR: a compact 300M-parameter model which attains 80.3% on olmOCR and 88.64 on OmniDocBench.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 28 Mar 2026.

Builds on

30 of 63 references.

References · 30

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2025DINOv3cited by 1,414
  7. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  8. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  9. 2021Grounded Language-Image Pre-trainingcited by 1,156
  10. 2025SAM 3: Segment Anything with Conceptscited by 906
  11. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  12. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
18 more
  1. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  2. 2023Scaling Open-Vocabulary Object Detectioncited by 343
  3. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  4. 2025PaddleOCR 3.0 Technical Reportcited by 143
  5. 2025olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language Modelscited by 125
  6. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
  7. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 89
  8. 2025PaddleOCR-VL: Boosting Multilingual Document Parsing via a 0.9B Ultra-Compact Vision-Language Modelcited by 89
  9. 2025MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigmcited by 87
  10. 2022UViM: A Unified Modeling Approach for Vision with Learned Guiding Codescited by 78
  11. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 74
  12. 2023LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Modelcited by 71
  13. 2026PaddleOCR-VL-1.5: Towards a Multi-Task 0.9B VLM for Robust In-the-Wild Document Parsingcited by 57
  14. 2024Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approachcited by 50
  15. 2025dots.ocr: Multilingual Document Layout Parsing in a Single Vision-Language Modelcited by 47
  16. 2017The iNaturalist Species Classification and Detection Datasetcited by 29
  17. 2025AnyUp: Universal Feature Upsamplingcited by 28
  18. 2025SigLino: Efficient Multi-Teacher Distillation for Agglomerative Vision Foundation Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.