# Multimodal Crowd Counting with Pix2Pix GANs

arXiv: https://arxiv.org/abs/2401.07591 · HTML: https://mlsanity.com/paper/2401.07591/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 33 references that are in the map.
- First posted on arXiv 15 Jan 2024.

## Builds on (most cited first, 19 of 19)

- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Going Deeper with Convolutions](https://mlsanity.com/paper/1409.4842/) (2014)
- [Conditional Generative Adversarial Nets](https://mlsanity.com/paper/1411.1784/) (2014)
- [CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes](https://mlsanity.com/paper/1802.10062/) (2018)
- [Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowds](https://mlsanity.com/paper/1808.01050/) (2018)
- [Context-Aware Crowd Counting](https://mlsanity.com/paper/1811.10452/) (2018)
- [Crowd Counting and Density Estimation by Trellis Encoder-Decoder Network](https://mlsanity.com/paper/1903.00853/) (2019)
- [CrowdNet: A Deep Convolutional Network for Dense Crowd Counting](https://mlsanity.com/paper/1608.06197/) (2016)
- [CNN-based Cascaded Multi-task Learning of High-level Prior and Density Estimation for Crowd Counting](https://mlsanity.com/paper/1707.09605/) (2017)
- [Multi-scale Convolutional Neural Networks for Crowd Counting](https://mlsanity.com/paper/1702.02359/) (2017)
- [Encoder-Decoder Based Convolutional Neural Networks with Multi-Scale-Aware Modules for Crowd Counting](https://mlsanity.com/paper/2003.05586/) (2020)
- [RGB-T Multi-Modal Crowd Counting Based on Transformer](https://mlsanity.com/paper/2301.03033/) (2023)
- [Deep Density-aware Count Regressor](https://mlsanity.com/paper/1908.03314/) (2019)
- [LCDnet: A Lightweight Crowd Density Estimation Model for Real-time Video Surveillance](https://mlsanity.com/paper/2302.05374/) (2023)
- [Crowd Counting in Harsh Weather using Image Denoising with Pix2Pix GANs](https://mlsanity.com/paper/2310.07245/) (2023)
- [Visual Crowd Analysis: Open Research Problems](https://mlsanity.com/paper/2308.10677/) (2023)
- [Why Existing Multimodal Crowd Counting Datasets Can Lead to Unfulfilled Expectations in Real-World Applications](https://mlsanity.com/paper/2304.06401/) (2023)

## Built on by (most cited first, 2 of 2)

- [Transformer-Based Dual-Optical Attention Fusion Crowd Head Point Counting and Localization Network](https://mlsanity.com/paper/2505.06937/) (2025)
- [Pix2Pix-Hybrid: Structure-Guided Conditional Synthesis of Hajj Crowd Images with Multi-Channel Conditioning and Weak Attribute Supervision](https://mlsanity.com/paper/2606.14297/) (2026)

## Abstract (arXiv)

Most state-of-the-art crowd counting methods use color (RGB) images to learn the density map of the crowd. However, these methods often struggle to achieve higher accuracy in densely crowded scenes with poor illumination. Recently, some studies have reported improvement in the accuracy of crowd counting models using a combination of RGB and thermal images. Although multimodal data can lead to better predictions, multimodal data might not be always available beforehand. In this paper, we propose the use of generative adversarial networks (GANs) to automatically generate thermal infrared (TIR) images from color (RGB) images and use both to train crowd counting models to achieve higher accuracy. We use a Pix2Pix GAN network first to translate RGB images to TIR images. Our experiments on several state-of-the-art crowd counting models and benchmark crowd datasets report significant improvement in accuracy.