Edges Before Embeddings: A Confidence-Aware Blur Gate for Vision-Language Pipelines
On the map: Multimodal LLMs / vision-language models → Visual token pruning and efficiency
Abstract (arXiv)
Production vision pipelines silently degrade on blurry input, wasting compute on downstream OCR, retrieval, and vision-language model (VLM) calls that cannot recover a usable output. We present MagikaDocumentFromPixel, a lightweight, CPU-friendly image quality gate that classifies a single image as sharp, blurred, or uncertain in roughly 7 ms on a single CPU core. The contributions are (i) a recipe selected from a 46-configuration, 8-sweep empirical search that isolates input resolution as the dominant lever and shows architecture capacity only pays off at >= 384 px; (ii) a confidence-aware routing formalism grounded in classical selective prediction; (iii) the Edge Prior Module (EPM), a Laplacian-magnitude auxiliary input channel that gives the network direct access to the spectral evidence that classical blur heuristics rely on and that lifts test F1 by +1.3 points in a matched-env comparison; and (iv) an observation that the gate is one instance of a recurring design pattern that appears independently in Magika content-type detection, risk-controlled OCR with VLMs, and DocVLM. The final recipe MobileNetV3-Large with the EPM trained at 384x384 on paired GoPro Large frames, evaluated with 5-scale test-time augmentation reaches F1 = 0.9803 (AUC 0.9989) with a 17 MB ONNX artifact, improving over our fixed-scale baseline on the same hardware (F1 = 0.9672) by +1.31 points. We are explicit about limitations: results are on a single motion-blur distribution, numbers are from a single seed, and calibration is qualitative rather than measured.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Visual token pruning and efficiency, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 9 of its 18 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
9 of 18 references.
References · 9
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2020Human-Aware Motion Deblurringcited by 174
- 2024DocVLM: Make Your VLM an Efficient Readercited by 27
- 2026Qianfan-OCR: A Unified End-to-End Model for Document Intelligencecited by 20
- 2024Magika: AI-Powered Content-Type Detectioncited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques, and Prospects
- 2026Edge Reliability Gap in Vision-Language Models: Quantifying Failure Modes of Compressed VLMs Under Visual Corruption
- 2024PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction
- 2026The Model Knows Which Tokens Matter: Automatic Token Selection via Noise Gating
- 2026VLM-RobustBench: A Comprehensive Benchmark for Robustness of Vision-Language Models
- 2026Corrupted but Correct: Why Vision-Language Models Lie to Themselves Internally
- 2026Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs
- 2025Variation-aware Vision Token Dropping for Faster Large Vision-Language Models