Associative Embedding: End-to-End Learning for Joint Detection and Grouping
Not on the map. Why?
Abstract (arXiv)
We introduce associative embedding, a novel method for supervising convolutional neural networks for the task of detection and grouping. A number of computer vision problems can be framed in this manner including multi-person pose estimation, instance segmentation, and multi-object tracking. Usually the grouping of detections is achieved with multi-stage pipelines, instead we propose an approach that teaches a network to simultaneously output detections and group assignments. This technique can be easily integrated into any state-of-the-art network architecture that produces pixel-wise predictions. We show how to apply this method to both multi-person pose estimation and instance segmentation and report state-of-the-art performance for multi-person pose on the MPII and MS-COCO datasets.
Key facts. Cited by 211 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 80; 2022: 51; 2023: 38; 2024: 22; 2025: 12; 2026: 8.
211 papers.
Sort:
By area:
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
- 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
- 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 106
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2021Pose Recognition with Cascade Transformerscited by 99
38 more
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 99
- 2021Graph Stacked Hourglass Networks for 3D Human Pose Estimationcited by 94
- 2021SG-Net: Spatial Granularity Network for One-Stage Video Instance Segmentationcited by 87
- 2021Video Instance Segmentation with a Propose-Reduce Paradigmcited by 74
- 2021SOLQ: Segmenting Objects by Learning Queriescited by 68
- 2021SimCC: a Simple Coordinate Classification Perspective for Human Pose Estimationcited by 68
- 2022YOLO-Pose: Enhancing YOLO for Multi Person Pose Estimation Using Object Keypoint Similarity Losscited by 66
- 2021Focus on Local: Detecting Lane Marker from Bottom Up via Key Pointcited by 65
- 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
- 2021Learning to Estimate Robust 3D Human Mesh from In-the-Wild Crowded Scenescited by 64
- 2023Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusioncited by 62
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2021OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Associationcited by 55
- 2021Recent Advances in Monocular 2D and 3D Human Pose Estimation: A Deep Learning Perspectivecited by 49
- 2022DiffusionInst: Diffusion Model for Instance Segmentationcited by 49
- 2023Explicit Box Detection Unifies End-to-End Multi-Person Pose Estimationcited by 48
- 2023Human Pose as Compositional Tokenscited by 45
- 2021VolumeFusion: Deep Depth Fusion for 3D Scene Reconstructioncited by 44
- 2021TFPose: Direct Human Pose Estimation with Transformerscited by 42
- 2021Spatial Feature Calibration and Temporal Fusion for Effective One-stage Video Instance Segmentationcited by 42
- 2021When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarkscited by 41
- 2021VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wildcited by 39
- 2021Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Trackingcited by 37
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
- 2021FCPose: Fully Convolutional Multi-Person Pose Estimation with Dynamic Instance-Aware Convolutionscited by 34
- 2021PlaneTR: Structure-Guided Transformers for 3D Plane Recoverycited by 33
- 2022Look Before You Match: Instance Understanding Matters in Video Object Segmentationcited by 33
- 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
- 2021Differentiable Multi-Granularity Human Representation Learning for Instance-Aware Human Semantic Parsingcited by 31
- 2022Action Quality Assessment with Temporal Parsing Transformercited by 31
- 2021Multi-Instance Pose Networks: Rethinking Top-Down Pose Estimationcited by 30
- 2021End-to-End Trainable Multi-Instance Pose Estimation with Transformerscited by 30
- 2023Group Pose: A Simple Baseline for End-to-End Multi-person Pose Estimationcited by 26
- 2022CLAMP: Prompt-based Contrastive Learning for Connecting Language and Animal Posecited by 25
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
- 2021Shape-aware Multi-Person Pose Estimation from Multi-View Imagescited by 24
- 2022ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wildcited by 23
- 2021PandaNet : Anchor-Based Single-Shot Multi-Person 3D Pose Estimationcited by 22
50 most cited of 211 All 211 (JSON)
- 2026Uncertainty-Aware Compositional Localization and Placement Assessment of Catheters and Tubes in Chest X-Rays11 Aug 2026
- 2026IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation3 Jun 2026
- 2026Neural Collapse by Design: Learning Class Prototypes on the Hypersphere19 May 2026
- 2026Dependency-Aware Discrete Diffusion for Scene Graph Generation9 May 2026
- 2026PoseDriver: A Unified Approach to Multi-Category Skeleton Detection for Autonomous Driving24 Mar 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026Spectrum Shortage for Radio Sensing? Leveraging Ambient 5G Signals for Human Activity Detection3 Mar 2026
- 2026DINOv3 Visual Representations for Blueberry Perception Toward Robotic Harvesting2 Mar 2026
- 2025High-Resolution Spatiotemporal Modeling with Global-Local State Space Models for Video-Based Human Pose Estimation13 Oct 2025
- 2025A Coarse-to-Fine Human Pose Estimation Method based on Two-stage Distillation and Progressive Graph Neural Network15 Aug 2025
- 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras30 Jul 2025
- 2025DeRIS: Decoupling Perception and Cognition for Enhanced Referring Image Segmentation through Loopback Synergy2 Jul 2025
38 more
- 2025Self-supervised One-Stage Learning for RF-based Multi-Person Pose Estimation5 Jun 2025
- 2025Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation4 May 2025
- 2025VISUALCENT: Visual Human Analysis using Dynamic Centroid Representation26 Apr 2025
- 2025Occlusion-Ordered Semantic Instance Segmentation18 Apr 2025
- 2025Multi-task Federated Learning with Encoder-Decoder Structure: Enabling Collaborative Learning Across Different Tasks14 Apr 2025
- 2025Leveraging Synthetic Adult Datasets for Unsupervised Infant Pose Estimation8 Apr 2025
- 2025Training-Free Dataset Pruning for Instance Segmentation2 Mar 2025
- 2025Transformers with Joint Tokens and Local-Global Attention for Efficient Human Pose Estimation28 Feb 2025
- 2024Measurement of Medial Elbow Joint Space using Landmark Detection17 Dec 2024
- 2024OCDet: Object Center Detection via Bounding Box-Aware Heatmap Prediction on Edge Devices with NPUs23 Nov 2024
- 2024Referring Human Pose and Mask Estimation in the Wild27 Oct 2024
- 2024DI-MaskDINO: A Joint Object Detection and Instance Segmentation Model22 Oct 2024
- 2024PCF-Lift: Panoptic Lifting by Probabilistic Contrastive Fusion14 Oct 2024
- 2024GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolution12 Sep 2024
- 2024EA-RAS: Towards Efficient and Accurate End-to-End Reconstruction of Anatomical Skeleton3 Sep 2024
- 2024Joint-Motion Mutual Learning for Pose Estimation in Videos5 Aug 2024
- 2024Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditions22 Jul 2024
- 2024TCFormer: Visual Recognition via Token Clustering Transformer16 Jul 2024
- 2024GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation15 Jul 2024
- 2024DIR-BHRNet: A Lightweight Network for Real-time Vision-based Multi-person Pose Estimation on Smartphones1 Jul 2024
- 2024Human Modelling and Pose Estimation Overview27 Jun 2024
- 2024PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptions20 Jun 2024
- 2024DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimation22 Apr 2024
- 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defect17 Apr 2024
- 2024SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation2 Apr 2024
- 2024Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planes25 Mar 2024
- 2024XPose: eXplainable Human Pose Estimation19 Mar 2024
- 2024NToP: NeRF-Powered Large-scale Dataset Generation for 2D and 3D Human Pose Estimation in Top-View Fisheye Images28 Feb 2024
- 2024DRSI-Net: Dual-Residual Spatial Interaction Network for Multi-Person Pose Estimation26 Feb 2024
- 2024PBADet: A One-Stage Anchor-Free Approach for Part-Body Association12 Feb 2024
- 2023STRIDE: Single-video based Temporally Continuous Occlusion-Robust 3D Pose Estimation24 Dec 2023
- 2023Deep-Learning-Assisted Analysis of Cataract Surgery Videos10 Dec 2023
- 2023You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perception9 Dec 2023
- 2023HEViTPose: High-Efficiency Vision Transformer for Human Pose Estimation22 Nov 2023
- 2023Modeling the Uncertainty with Maximum Discrepant Students for Semi-supervised 2D Pose Estimation3 Nov 2023
- 2023Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey19 Oct 2023
- 2023Cell Tracking-by-detection using Elliptical Bounding Boxes7 Oct 2023
- 2023Completing Visual Objects via Bridging Generation and Segmentation1 Oct 2023
50 newest of 211 All 211 (JSON)
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 199
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 170
- 2021Human Pose Regression with Residual Log-likelihood Estimationcited by 131
- 2021AP-10K: A Benchmark for Animal Pose Estimation in the Wildcited by 123
- 2021Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regressioncited by 112
- 2021TokenPose: Learning Keypoint Tokens for Human Pose Estimationcited by 106
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2021Pose Recognition with Cascade Transformerscited by 99
12 most cited of 208 All 208 (JSON)
- 2026Uncertainty-Aware Compositional Localization and Placement Assessment of Catheters and Tubes in Chest X-Rays11 Aug 2026
- 2026IMPose: Interactive Multi-person Pose Estimation with Dynamic Correction Propagation3 Jun 2026
- 2026Neural Collapse by Design: Learning Class Prototypes on the Hypersphere19 May 2026
- 2026PoseDriver: A Unified Approach to Multi-Category Skeleton Detection for Autonomous Driving24 Mar 2026
- 2026CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation10 Mar 2026
- 2026Spectrum Shortage for Radio Sensing? Leveraging Ambient 5G Signals for Human Activity Detection3 Mar 2026
- 2026DINOv3 Visual Representations for Blueberry Perception Toward Robotic Harvesting2 Mar 2026
- 2025A Coarse-to-Fine Human Pose Estimation Method based on Two-stage Distillation and Progressive Graph Neural Network15 Aug 2025
- 2025From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras30 Jul 2025
- 2025DeRIS: Decoupling Perception and Cognition for Enhanced Referring Image Segmentation through Loopback Synergy2 Jul 2025
- 2025Self-supervised One-Stage Learning for RF-based Multi-Person Pose Estimation5 Jun 2025
- 2025Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation4 May 2025
12 newest of 208 All 208 (JSON)