mlsanityData to 7 Oct 2026

Emojich -- zero-shot emoji generation using Russian language: a technical report

arXiv 2112.02448 ↗First posted 4 Dec 2021cs.CL cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

This technical report presents a text-to-image neural network "Emojich" that generates emojis using captions in Russian language as a condition. We aim to keep the generalization ability of a pretrained big model ruDALL-E Malevich (XL) 1.3B parameters at the fine-tuning stage, while giving special style to the images generated. Here are presented some engineering methods, code realization, all hyper-parameters for reproducing results and a Telegram bot where everyone can create their own customized sets of stickers. Also, some newly generated emojis obtained by "Emojich" model are demonstrated.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 4 Dec 2021.

Builds on

14 of 23 references.

References · 14

  1. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  3. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  4. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  5. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 691
  6. 20218-bit Optimizers via Block-wise Quantizationcited by 395
  7. 2020On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselinescited by 254
  8. 2021Pretrained Transformers as Universal Computation Enginescited by 162
  9. 2016GANS for Sequences of Discrete Elements with the Gumbel-softmax Distributioncited by 47
  10. 2020Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learningcited by 25
  11. 2021MobileStyleGAN: A Lightweight Convolutional Neural Network for High-Fidelity Image Synthesiscited by 10
  12. 2017Conditional Generative Adversarial Networks for Emoji Synthesis with Word Embedding Manipulationcited by 3
2 more
  1. 2021Fine-tuning Vision Transformers for the Prediction of State Variables in Ising Modelscited by 3
  2. 2021Investigating Transfer Learning Capabilities of Vision Transformers and CNNs by Fine-Tuning a Single Trainable Blockcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 2.

2 papers.

  1. 2022Eco2AI: carbon emissions tracking of machine learning models as the first step towards sustainable AIcited by 58
  2. 2022Few-Bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reductioncited by 14