# Bowtie Networks: Generative Modeling for Joint Few-Shot Recognition and Novel-View Synthesis

arXiv: https://arxiv.org/abs/2008.06981 · HTML: https://mlsanity.com/paper/2008.06981/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 16 Aug 2020.

## Built on by (most cited first, 6 of 6)

- [Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigation](https://mlsanity.com/paper/2210.04524/) (2022)
- [Hallucination Improves the Performance of Unsupervised Visual Representation Learning](https://mlsanity.com/paper/2307.12168/) (2023)
- [Generative Modeling for Multi-task Visual Learning](https://mlsanity.com/paper/2106.13409/) (2021)
- [Beyond RGB: Scene-Property Synthesis with Neural Radiance Fields](https://mlsanity.com/paper/2206.04669/) (2022)
- [Multi-task View Synthesis with Neural Radiance Fields](https://mlsanity.com/paper/2309.17450/) (2023)
- [Few-Shot Learning for Clinical Natural Language Processing Using Siamese Neural Networks](https://mlsanity.com/paper/2208.14923/) (2022)

## Abstract (arXiv)

We propose a novel task of joint few-shot recognition and novel-view synthesis: given only one or few images of a novel object from arbitrary views with only category annotation, we aim to simultaneously learn an object classifier and generate images of that type of object from new viewpoints. While existing work copes with two or more tasks mainly by multi-task learning of shareable feature representations, we take a different perspective. We focus on the interaction and cooperation between a generative model and a discriminative model, in a way that facilitates knowledge to flow across tasks in complementary directions. To this end, we propose bowtie networks that jointly learn 3D geometric and semantic representations with a feedback loop. Experimental evaluation on challenging fine-grained recognition datasets demonstrates that our synthesized images are realistic from multiple viewpoints and significantly improve recognition performance as ways of data augmentation, especially in the low-data regime. Code and pre-trained models are released at https://github.com/zpbao/bowtie_networks.