mlsanityData to 7 Oct 2026

TextBoost: Boosting Scene Text Fidelity in Ultra-low Bitrate Image Compression

arXiv 2603.04115 ↗First posted 4 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Ultra-low bitrate image compression faces a critical challenge: preserving small-font scene text while maintaining overall visual quality. Region-of-interest (ROI) bit allocation can prioritize text but often degrades global fidelity, leading to a trade-off between local accuracy and overall image quality. Instead of relying on ROI coding, we incorporate auxiliary textual information extracted by OCR and transmitted with negligible overhead, enabling the decoder to leverage this semantic guidance. Our method, TextBoost, operationalizes this idea through three strategic designs: (i) adaptively filtering OCR outputs and rendering them into a guidance map; (ii) integrating this guidance with decoder features in a calibrated manner via an attention-guided fusion block; and (iii) enforcing guidance-consistent reconstruction in text regions with a regularizing loss that promotes natural blending with the scene. Extensive experiments on TextOCR and ICDAR 2015 demonstrate that TextBoost yields up to 60.6% higher text-recognition F1 at comparable Peak Signal-to-Noise Ratio (PSNR) and bits per pixel (bpp), producing sharper small-font text while preserving global image quality and effectively decoupling text enhancement from global rate-distortion optimization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

29 of 38 references.

References · 29

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  3. 2018Variational image compression with a scale hyperpriorcited by 910
  4. 2016End-to-end Optimized Image Compressioncited by 673
  5. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  6. 2017The Perception-Distortion Tradeoffcited by 582
  7. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  8. 2020High-Fidelity Generative Image Compressioncited by 331
  9. 2022ELIC: Efficient Learned Image Compression with Unevenly Grouped Space-Channel Contextual Adaptive Codingcited by 296
  10. 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 213
  11. 2023Learned Image Compression with Mixed Transformer-CNN Architecturescited by 205
  12. 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
17 more
  1. 2022Lossy Image Compression with Conditional Diffusion Modelscited by 165
  2. 2023Towards image compression with perfect realism at ultra-low bitratescited by 99
  3. 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
  4. 2023Text + Sketch: Image Compression at Ultra Low Ratescited by 63
  5. 2021Variable-Rate Deep Image Compression through Spatially-Adaptive Feature Transformcited by 56
  6. 2021Lossy Compression for Lossless Predictioncited by 51
  7. 2024Lossy Image Compression with Foundation Diffusion Modelscited by 34
  8. 2022Extreme Generative Image Compression by Learning Text Embedding from Diffusion Modelscited by 30
  9. 2023Towards Unified Scene Text Spotting based on Sequence Generationcited by 27
  10. 2024Idempotence and Perceptual Image Compressioncited by 27
  11. 2023Compression with Bayesian Implicit Neural Representationscited by 25
  12. 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 21
  13. 2024Neural Image Compression with Text-guided Encoding for both Pixel-level and Perceptual Fidelitycited by 20
  14. 2022Flexible Neural Image Compression via Code Editingcited by 19
  15. 2022Multi-Sample Training for Neural Image Compressioncited by 5
  16. 2023Deep Image Compression Using Scene Text Quality Assessmentcited by 4
  17. 2023Neural Image Compression: Generalization, Robustness, and Spectral Biasescited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.