TextBoost: Boosting Scene Text Fidelity in Ultra-low Bitrate Image Compression
Not on the map. Why?
Abstract (arXiv)
Ultra-low bitrate image compression faces a critical challenge: preserving small-font scene text while maintaining overall visual quality. Region-of-interest (ROI) bit allocation can prioritize text but often degrades global fidelity, leading to a trade-off between local accuracy and overall image quality. Instead of relying on ROI coding, we incorporate auxiliary textual information extracted by OCR and transmitted with negligible overhead, enabling the decoder to leverage this semantic guidance. Our method, TextBoost, operationalizes this idea through three strategic designs: (i) adaptively filtering OCR outputs and rendering them into a guidance map; (ii) integrating this guidance with decoder features in a calibrated manner via an attention-guided fusion block; and (iii) enforcing guidance-consistent reconstruction in text regions with a regularizing loss that promotes natural blending with the scene. Extensive experiments on TextOCR and ICDAR 2015 demonstrate that TextBoost yields up to 60.6% higher text-recognition F1 at comparable Peak Signal-to-Noise Ratio (PSNR) and bits per pixel (bpp), producing sharper small-font text while preserving global image quality and effectively decoupling text enhancement from global rate-distortion optimization.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
29 of 38 references.
References · 29
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2016End-to-end Optimized Image Compressioncited by 673
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2017The Perception-Distortion Tradeoffcited by 582
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
- 2020High-Fidelity Generative Image Compressioncited by 331
- 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 213
- 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
17 more
- 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 99
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
- 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
- 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 56
- 2021Lossy Compression for Lossless Predictioncited by 51
- 2024Lossy Image Compression with Foundation Diffusion Modelscited by 34
- 2022Extreme Generative Image Compression by Learning Text Embedding from Diffusion Modelscited by 30
- 2023Towards Unified Scene Text Spotting based on Sequence Generationcited by 27
- 2024Idempotence and Perceptual Image Compressioncited by 27
- 2023Compression with Bayesian Implicit Neural Representationscited by 25
- 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 21
- 2024Neural Image Compression with Text-guided Encoding for both Pixel-level and Perceptual Fidelitycited by 20
- 2022Flexible Neural Image Compression via Code Editingcited by 19
- 2022Multi-Sample Training for Neural Image Compressioncited by 5
- 2023Deep Image Compression Using Scene Text Quality Assessmentcited by 4
- 2023Neural Image Compression: Generalization, Robustness, and Spectral Biasescited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Rate-Adaptive One-Step Diffusion Compression for AIGC Images25 Sep 2026