mlsanityData to 7 Oct 2026

Collaborative Neural Rendering using Anime Character Sheets

arXiv 2207.05378 ↗First posted 12 Jul 2022cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Drawing images of characters with desired poses is an essential but laborious task in anime production. Assisting artists to create is a research hotspot in recent years. In this paper, we present the Collaborative Neural Rendering (CoNR) method, which creates new images for specified poses from a few reference images (AKA Character Sheets). In general, the diverse hairstyles and garments of anime characters defies the employment of universal body models like SMPL, which fits in most nude human shapes. To overcome this, CoNR uses a compact and easy-to-obtain landmark encoding to avoid creating a unified UV mapping in the pipeline. In addition, the performance of CoNR can be significantly improved when referring to multiple reference images, thanks to feature space cross-view warping in a carefully designed neural network. Moreover, we have collected a character sheet dataset containing over 700,000 hand-drawn and synthesized images of diverse poses to facilitate research in this area. Our code and demo are available at https://github.com/megvii-research/IJCAI2023-CoNR.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 48 of its 75 references that are in the map. First posted on arXiv 12 Jul 2022.

Builds on

48 of 75 references.

References · 48

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  8. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  9. 2017Deformable Convolutional Networkscited by 1,481
  10. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  11. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  12. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
36 more
  1. 2020First Order Motion Model for Image Animationcited by 698
  2. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  3. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  4. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  5. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  6. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  7. 2018Everybody Dance Nowcited by 313
  8. 2021Motion Representations for Articulated Animationcited by 253
  9. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  10. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  11. 2016View Synthesis by Appearance Flowcited by 172
  12. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  13. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  14. 2021Neural-GIF: Neural Generalized Implicit Functions for Animating People in Clothingcited by 102
  15. 2018Single Image Reflection Separation with Perceptual Lossescited by 98
  16. 2018Synthesizing Images of Humans in Unseen Posescited by 96
  17. 2020Continuous Surface Embeddingscited by 79
  18. 2019Learning to Paint With Model-based Deep Reinforcement Learningcited by 70
  19. 2021Deep Animation Video Interpolation in the Wildcited by 65
  20. 2020PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformationcited by 63
  21. 2020Portrait Neural Radiance Fields from a Single Imagecited by 61
  22. 2021Neural Re-Rendering of Humans from a Single Imagecited by 59
  23. 2020ANR: Articulated Neural Rendering for Virtual Avatarscited by 55
  24. 2020Pose-Guided Human Animation from a Single Image in the Wildcited by 53
  25. 2021EigenGAN: Layer-Wise Eigen-Learning for GANscited by 34
  26. 2017Towards the Automatic Anime Characters Creation with Generative Adversarial Networkscited by 29
  27. 2020Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesiscited by 26
  28. 2019DenseBody: Directly Regressing Dense 3D Human Pose and Shape From a Single Color Imagecited by 20
  29. 2021Improving the Perceptual Quality of 2D Animation Interpolationcited by 20
  30. 2018Improving Shape Deformation in Unsupervised Image-to-Image Translationcited by 19
  31. 2021Deep Permutation Equivariant Structure from Motioncited by 15
  32. 2021Surrogate Gradient Field for Latent Space Manipulationcited by 12
  33. 2020Modeling Artistic Workflows for Image Generation and Editingcited by 11
  34. 2020Single-Shot Freestyle Dance Reenactmentcited by 10
  35. 2020Learning to Shadow Hand-drawn Sketchescited by 6
  36. 2021Template-Free Try-on Image Synthesis via Semantic-guided Optimizationcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2; 2025: 3.

8 papers.

  1. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 158
  2. 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
  3. 2025Generative AI for Cel-Animation: A Surveycited by 17
  4. 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characterscited by 16
  5. 2024One missing piece in Vision and Language: A Survey on Comics Understandingcited by 8
  6. 2025ViStoryBench: Comprehensive Benchmark Suite for Story Visualizationcited by 2
  7. 2023Talking Head(?) Anime from a Single Image 4: Improved Model and Its Distillationcited by 0
  8. 2025Learning High-Fidelity Cloth Animation via Skinning-Free Image Transfercited by 0