mlsanityData to 7 Oct 2026

MediaPipe: A Framework for Building Perception Pipelines

arXiv 1906.08172 ↗First posted 14 Jun 2019cs.DCcited by 572

Not on the map. Why?

Cited by 44 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Building applications that perceive the world around them is challenging. A developer needs to (a) select and develop corresponding machine learning algorithms and models, (b) build a series of prototypes and demos, (c) balance resource consumption against the quality of the solutions, and finally (d) identify and mitigate problematic cases. The MediaPipe framework addresses all of these challenges. A developer can use MediaPipe to build prototypes by combining existing perception components, to advance them to polished cross-platform applications and measure system performance and resource consumption on target platforms. We show that these features enable a developer to focus on the algorithm or model development and use MediaPipe as an environment for iteratively improving their application with results reproducible across different devices and platforms. MediaPipe will be open-sourced at https://github.com/google/mediapipe.

Key facts. Cited by 572 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jun 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 13; 2022: 33; 2023: 78; 2024: 145; 2025: 168; 2026: 135.

572 papers.

Sort:

By area:

  1. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  2. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  3. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  4. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 229
  5. 2021Neural Head Avatars from Monocular RGB Videoscited by 212
  6. 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
  7. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  8. 2024AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animationcited by 191
  9. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  10. 2022Instant Volumetric Head Avatarscited by 157
  11. 20233D Human Pose Estimation via Intuitive Physicscited by 100
  12. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
38 more
  1. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 97
  2. 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
  3. 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
  4. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
  5. 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
  6. 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 74
  7. 2025Motion Tracks: A Unified Representation for Human-Robot Transfer in Few-Shot Imitation Learningcited by 57
  8. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
  9. 2024LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervisioncited by 53
  10. 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
  11. 2024Dyn-HaMR: Recovering 4D Interacting Hand Motion from a Dynamic Cameracited by 50
  12. 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 48
  13. 2022Retrospectives on the Embodied AI Workshopcited by 46
  14. 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
  15. 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
  16. 2023HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpaintingcited by 42
  17. 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
  18. 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generationcited by 41
  19. 2025Follow-Your-Emoji-Faster: Towards Efficient, Fine-Controllable, and Expressive Freestyle Portrait Animationcited by 41
  20. 2024HRP: Human Affordances for Robotic Pre-Trainingcited by 40
  21. 2023Sign Language Translation from Instructional Videoscited by 39
  22. 2024Instant Policy: In-Context Imitation Learning via Graph Diffusioncited by 38
  23. 2023Non-Contrastive Unsupervised Learning of Physiological Signals from Videocited by 37
  24. 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
  25. 2024VLM See, Robot Do: Human Demo Video to Robot Action Plan via Vision Language Modelcited by 36
  26. 2023ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognitioncited by 34
  27. 2024HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splattingcited by 33
  28. 2024TANGO: Co-Speech Gesture Video Reenactment with Hierarchical Audio Motion Embedding and Diffusion Interpolationcited by 32
  29. 2025DualTalk: Dual-Speaker Interaction for 3D Talking Head Conversationscited by 31
  30. 2024Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Cameracited by 30
  31. 2023Speech Driven Video Editing via an Audio-Conditioned Diffusion Modelcited by 28
  32. 2024AI-Face: A Million-Scale Demographically Annotated AI-Generated Face Dataset and Fairness Benchmarkcited by 28
  33. 2024MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Datasetcited by 28
  34. 2022K-VIL: Keypoints-based Visual Imitation Learningcited by 27
  35. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 26
  36. 2023HMP: Hand Motion Priors for Pose and Shape Estimation from Videocited by 23
  37. 2024GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Promptingcited by 22
  38. 2024SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Predictioncited by 22

50 most cited of 572 All 572 (JSON)