mlsanityData to 14 Oct 2026

Learning Representations for Automatic Colorization

arXiv 1603.06668 ↗First posted 22 Mar 2016cs.CVcited by 251

Not on the map. Why?

Abstract (arXiv)

We develop a fully automatic image colorization system. Our approach leverages recent advances in deep networks, exploiting both low-level and semantic representations. As many scene elements naturally appear according to multimodal color distributions, we train our model to predict per-pixel color histograms. This intermediate output can be used to automatically generate a color image, or further manipulated prior to image formation. On both fully and partially automatic colorization tasks, we outperform existing methods. We also explore colorization as a vehicle for self-supervised visual representation learning.

Key facts. Cited by 251 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Mar 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 80; 2022: 76; 2023: 50; 2024: 29; 2025: 12; 2026: 4.

251 papers.

Sort:

By area:

  1. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  2. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  3. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  4. 2022Denoising Diffusion Restoration Modelscited by 963
  5. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  6. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  7. 2021GAN Inversion: A Surveycited by 367
  8. 2022Masked Siamese Networks for Label-Efficient Learningcited by 302
  9. 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
  10. 2023A Cookbook of Self-Supervised Learningcited by 250
  11. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
  12. 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
38 more
  1. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  2. 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
  3. 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 199
  4. 2021SCARF: Self-Supervised Contrastive Learning using Random Feature Corruptioncited by 156
  5. 2021Efficient Self-supervised Vision Transformers for Representation Learningcited by 149
  6. 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
  7. 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
  8. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
  9. 2021SiT: Self-supervised vIsion Transformercited by 99
  10. 2021Colorization Transformercited by 89
  11. 2021Mean-Shifted Contrastive Loss for Anomaly Detectioncited by 88
  12. 2023Monocular Depth Estimation using Diffusion Modelscited by 87
  13. 2022Self-Supervised Learning for Videos: A Surveycited by 85
  14. 2021Prototypical Cross-domain Self-supervised Learning for Few-shot Unsupervised Domain Adaptationcited by 83
  15. 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
  16. 2021Robust Audio-Visual Instance Discriminationcited by 80
  17. 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
  18. 2021Self-Supervised Learning with Kernel Dependence Maximizationcited by 77
  19. 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
  20. 2022Masked Frequency Modeling for Self-Supervised Visual Pre-Trainingcited by 71
  21. 2023Best of Both Worlds: Multimodal Contrastive Learning with Tabular and Imaging Datacited by 69
  22. 2022Unsupervised Object Localization: Observing the Background to Discover Objectscited by 66
  23. 2021Spatially Consistent Representation Learningcited by 64
  24. 2021Preservational Learning Improves Self-supervised Medical Image Models by Reconstructing Diverse Contextscited by 60
  25. 2022Bootstrapped Masked Autoencoders for Vision BERT Pretrainingcited by 60
  26. 2021Few-Shot Lifelong Learningcited by 59
  27. 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 59
  28. 2022A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyondcited by 58
  29. 2021Exploring Complementary Strengths of Invariant and Equivariant Representations for Few-Shot Learningcited by 56
  30. 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
  31. 2022Robust Cross-Modal Representation Learning with Progressive Self-Distillationcited by 55
  32. 2021Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuningcited by 50
  33. 2021Unsupervised Action Segmentation by Joint Representation Learning and Online Clusteringcited by 49
  34. 2021Improving Transferability of Representations via Augmentation-Aware Self-Supervisioncited by 49
  35. 2021Self-Supervised Material and Texture Representation Learning for Remote Sensing Taskscited by 49
  36. 2021Learning by Aligning Videos in Timecited by 48
  37. 2021Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learningcited by 47
  38. 2022HCSC: Hierarchical Contrastive Selective Codingcited by 43

50 most cited of 251 All 251 (JSON)