mlsanityData to 14 Oct 2026

PE-former: Pose Estimation Transformer

arXiv 2112.04981 ↗First posted 9 Dec 2021cs.CV cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Vision transformer architectures have been demonstrated to work very effectively for image classification tasks. Efforts to solve more challenging vision tasks with transformers rely on convolutional backbones for feature extraction. In this paper we investigate the use of a pure transformer architecture (i.e., one with no CNN backbone) for the problem of 2D body pose estimation. We evaluate two ViT architectures on the COCO dataset. We demonstrate that using an encoder-decoder transformer architecture yields state of the art results on this estimation problem.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 18 of its 19 references that are in the map. First posted on arXiv 9 Dec 2021.

Builds on

18 of 19 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  8. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  9. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  10. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  11. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
  12. 2018Simple Baselines for Human Pose Estimation and Trackingcited by 502
6 more
  1. 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
  2. 2021XCiT: Cross-Covariance Image Transformerscited by 338
  3. 2020TransPose: Keypoint Localization via Transformercited by 126
  4. 2021Pose Recognition with Cascade Transformerscited by 99
  5. 2021TFPose: Direct Human Pose Estimation with Transformerscited by 42
  6. 2021End-to-End Trainable Multi-Instance Pose Estimation with Transformerscited by 30

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 5.

7 papers.

  1. 2022TORE: Token Reduction for Efficient Human Mesh Recovery with Transformercited by 41
  2. 2023CCMR: High Resolution Optical Flow Estimation via Coarse-to-Fine Context-Guided Motion Reasoningcited by 15
  3. 2023DistilPose: Tokenized Pose Regression with Heatmap Distillationcited by 12
  4. 2023Mitigating Motion Blur for Robust 3D Baseball Player Pose Modeling for Pitch Analysiscited by 8
  5. 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Surveycited by 6
  6. 2022Video based Object 6D Pose Estimation using Transformerscited by 5
  7. 2023ConvFormer: Parameter Reduction in Transformer Models for 3D Human Pose Estimation by Leveraging Dynamic Multi-Headed Convolutional Attentioncited by 1