# Shifted Autoencoders for Point Annotation Restoration in Object Counting

arXiv: https://arxiv.org/abs/2312.07190 · HTML: https://mlsanity.com/paper/2312.07190/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 29 of its 51 references that are in the map.
- First posted on arXiv 12 Dec 2023.

## Builds on (most cited first, 29 of 29)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Masked Autoencoders Are Scalable Vision Learners](https://mlsanity.com/paper/2111.06377/) (2021)
- [CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenes](https://mlsanity.com/paper/1802.10062/) (2018)
- [Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowds](https://mlsanity.com/paper/1808.01050/) (2018)
- [Bayesian Loss for Crowd Count Estimation with Point Supervision](https://mlsanity.com/paper/1908.03684/) (2019)
- [Rethinking Counting and Localization in Crowds:A Purely Point-Based Framework](https://mlsanity.com/paper/2107.12746/) (2021)
- [Context-Aware Crowd Counting](https://mlsanity.com/paper/1811.10452/) (2018)
- [JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Method](https://mlsanity.com/paper/2004.03597/) (2020)
- [An End-to-End Transformer Model for Crowd Localization](https://mlsanity.com/paper/2202.13065/) (2022)
- [Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detection](https://mlsanity.com/paper/1906.07538/) (2019)
- [Boosting Crowd Counting via Multifaceted Attention](https://mlsanity.com/paper/2203.02636/) (2022)
- [Rethinking Spatial Invariance of Convolutional Networks for Object Counting](https://mlsanity.com/paper/2206.05253/) (2022)
- [CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Model](https://mlsanity.com/paper/2304.04231/) (2023)
- [CNN-based Cascaded Multi-task Learning of High-level Prior and Density Estimation for Crowd Counting](https://mlsanity.com/paper/1707.09605/) (2017)
- [STEERER: Resolving Scale Variations for Counting and Localization via Selective Inheritance Learning](https://mlsanity.com/paper/2308.10468/) (2023)
- [Point-Query Quadtree for Crowd Counting, Localization, and More](https://mlsanity.com/paper/2308.13814/) (2023)
- [Focal Inverse Distance Transform Maps for Crowd Localization](https://mlsanity.com/paper/2102.07925/) (2021)
- [AutoScale: Learning to Scale for Crowd Counting and Localization](https://mlsanity.com/paper/1912.09632/) (2019)
- [Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting](https://mlsanity.com/paper/1907.12428/) (2019)
- [Count-ception: Counting by Fully Convolutional Redundant Counting](https://mlsanity.com/paper/1703.08710/) (2017)
- [People, Penguins and Petri Dishes: Adapting Object Counting Models To New Visual Domains And Object Types Without Forgetting](https://mlsanity.com/paper/1711.05586/) (2017)
- [Crowded Scene Analysis: A Survey](https://mlsanity.com/paper/1502.01812/) (2015)
- [Counting from Sky: A Large-scale Dataset for Remote Sensing Object Counting and A Benchmark Method](https://mlsanity.com/paper/2008.12470/) (2020)
- [Counting Crowds in Bad Weather](https://mlsanity.com/paper/2306.01209/) (2023)
- [Boosting Detection in Crowd Analysis via Underutilized Output Features](https://mlsanity.com/paper/2308.16187/) (2023)
- [Fine-Grained Crowd Counting](https://mlsanity.com/paper/2007.06146/) (2020)
- [RGB-D Indiscernible Object Counting in Underwater Scenes](https://mlsanity.com/paper/2304.11677/) (2023)
- [PSGCNet: A Pyramidal Scale and Global Context Guided Network for Dense Object Counting in Remote Sensing Images](https://mlsanity.com/paper/2012.03597/) (2020)

## Built on by (most cited first, 2 of 2)

- [Consistent-Point: Consistent Pseudo-Points for Semi-Supervised Crowd Counting and Localization](https://mlsanity.com/paper/2503.12441/) (2025)
- [Decoupling What to Count and Where to See for Referring Expression Counting](https://mlsanity.com/paper/2510.24374/) (2025)

## Abstract (arXiv)

Object counting typically uses 2D point annotations. The complexity of object shapes and the subjectivity of annotators may lead to annotation inconsistency, potentially confusing counting model training. Some sophisticated noise-resistance counting methods have been proposed to alleviate this issue. Differently, we aim to directly refine the initial point annotations before training counting models. For that, we propose the Shifted Autoencoders (SAE), which enhances annotation consistency. Specifically, SAE applies random shifts to initial point annotations and employs a UNet to restore them to their original positions. Similar to MAE reconstruction, the trained SAE captures general position knowledge and ignores specific manual offset noise. This allows to restore the initial point annotations to more general and thus consistent positions. Extensive experiments show that using such refined consistent annotations to train some advanced (including noise-resistance) object counting models steadily/significantly boosts their performances. Remarkably, the proposed SAE helps to set new records on nine datasets. We will make codes and refined point annotations available.