mlsanityData to 7 Oct 2026

AceTone: Bridging Words and Colors for Conditional Image Grading

arXiv 2604.00530 ↗First posted 1 Apr 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Color affects how we interpret image style and emotion. Previous color grading methods rely on patch-wise recoloring or fixed filter banks, struggling to generalize across creative intents or align with human aesthetic preferences. In this study, we propose AceTone, the first approach that supports multimodal conditioned color grading within a unified framework. AceTone formulates grading as a generative color transformation task, where a model directly produces 3D-LUTs conditioned on text prompts or reference images. We develop a VQ-VAE based tokenizer which compresses a 3×323 LUT vector to 64 discrete tokens with Delta E<2 fidelity. We further build a large-scale dataset, AceTone-800K, and train a vision-language model to predict LUT tokens, followed by reinforcement learning to align outputs with perceptual fidelity and aesthetics. Experiments show that AceTone achieves state-of-the-art performance on both text-guided and reference-guided grading tasks, improving LPIPS by up to 50% over existing methods. Human evaluations confirm that AceTone's results are visually pleasing and stylistically coherent, demonstrating a new pathway toward language-driven, aesthetic-aligned color grading.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

29 of 36 references.

References · 29

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  9. 2018Which Training Methods for GANs do actually Converge?cited by 672
  10. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  11. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  12. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
17 more
  1. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
  2. 2017Deep Photo Style Transfercited by 168
  3. 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
  4. 2020Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-timecited by 163
  5. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
  6. 2022AdaInt: Learning Adaptive Intervals for 3D Lookup Tables on Real-time Image Enhancementcited by 70
  7. 2021PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistencycited by 59
  8. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
  9. 2023Neural Preset for Color Style Transfercited by 36
  10. 2023NILUT: Conditional Neural Implicit 3D Lookup Tables for Image Enhancementcited by 31
  11. 2025ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustnesscited by 28
  12. 2020Deep Preset: Blending and Retouching Photos with Color Style Transfercited by 18
  13. 2024CLIPtone: Unsupervised Learning for Text-based Image Tone Adjustmentcited by 10
  14. 2025Consolidating Reinforcement Learning for Multimodal Discrete Diffusion Modelscited by 9
  15. 2025SA-LUT: Spatial Adaptive 4D Look-Up Table for Photorealistic Style Transfercited by 8
  16. 2025Color Transfer with Modulated Flowscited by 7
  17. 2024Efficient Neural Network Encoding for 3D Color Lookup Tablescited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multimodal Image Colorization: Quantifying the Impact of Text-Conditioned Guidance on Grayscale-to-Color Translation
  2. 2025Video Color Grading via Look-Up Table Generation
  3. 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learning
  4. 2026Recolour What Matters: Region-Aware Colour Editing via Token-Level Diffusion
  5. 2025Palette Aligned Image Diffusion
  6. 2023VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining
  7. 2024UniQA: Unified Vision-Language Pre-training for Image Quality and Aesthetic Assessment
  8. 2024Multimodal Semantic-Aware Automatic Colorization with Diffusion Prior