# RoboCoDraw: Robotic Avatar Drawing with GAN-based Style Transfer and Time-efficient Path Optimization

arXiv: https://arxiv.org/abs/1912.05099 · HTML: https://mlsanity.com/paper/1912.05099/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 11 Dec 2019.

## Built on by (most cited first, 4 of 4)

- [Freehand Sketch Generation from Mechanical Components](https://mlsanity.com/paper/2408.05966/) (2024)
- [RoboSVG: A Unified Framework for Interactive SVG Generation with Multi-modal Guidance](https://mlsanity.com/paper/2510.22684/) (2025)
- [XCI-Sketch: Extraction of Color Information from Images for Generation of Colored Outlines and Sketches](https://mlsanity.com/paper/2108.11554/) (2021)
- [Shapes2Toon: Generating Cartoon Characters from Simple Geometric Shapes](https://mlsanity.com/paper/2211.02141/) (2022)

## Abstract (arXiv)

Robotic drawing has become increasingly popular as an entertainment and interactive tool. In this paper we present RoboCoDraw, a real-time collaborative robot-based drawing system that draws stylized human face sketches interactively in front of human users, by using the Generative Adversarial Network (GAN)-based style transfer and a Random-Key Genetic Algorithm (RKGA)-based path optimization. The proposed RoboCoDraw system takes a real human face image as input, converts it to a stylized avatar, then draws it with a robotic arm. A core component in this system is the Avatar-GAN proposed by us, which generates a cartoon avatar face image from a real human face. AvatarGAN is trained with unpaired face and avatar images only and can generate avatar images of much better likeness with human face images in comparison with the vanilla CycleGAN. After the avatar image is generated, it is fed to a line extraction algorithm and converted to sketches. An RKGA-based path optimization algorithm is applied to find a time-efficient robotic drawing path to be executed by the robotic arm. We demonstrate the capability of RoboCoDraw on various face images using a lightweight, safe collaborative robot UR5.
