ISExplore:Informative Segment Selection for Efficient Personalized 3D Talking Face Generation
Not on the map. Why?
Abstract (arXiv)
Talking Face Generation (TFG) methods based on Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have recently achieved impressive progress in personalized talking head synthesis. However, existing methods typically require several minutes of reference video for meticulous preprocessing and fitting, resulting in hours of preparation time and limiting their practical applicability. In this paper, we revisit a fundamental yet underexplored question: do high-quality personalized TFG models truly require minutes-long reference videos? Our exploratory study reveals that a carefully selected reference segment of only a few seconds can often achieve performance comparable to that of using the full reference video. This finding suggests that the informativeness of reference data is more critical than its duration. Motivated by this observation, we propose ISExplore (Informative Segment Explore), a simple yet effective segment selection strategy that automatically identifies the most informative short reference segment based on three key data quality dimensions: audio feature diversity, lip movement amplitude, and viewpoint diversity. Extensive experiments demonstrate that ISExplore reduces data processing and training time by over 5x for both NeRF- and 3DGS-based methods, while preserving high-fidelity generation quality. Our method provides a practical and efficient solution for personalized TFG and offers new insights into data efficiency in 3D talking face generation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
30 of 45 references.
References · 30
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 525
- 2025LIMO: Less is More for Reasoningcited by 498
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2023What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuningcited by 364
- 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 312
18 more
- 2019Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Losscited by 252
- 2018Talking Face Generation by Adversarially Disentangled Audio-Visual Representationcited by 212
- 2018Lip Movements Generation at a Glancecited by 155
- 2025LIMR: Less is More for RL Scalingcited by 139
- 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 121
- 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 98
- 2024Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesiscited by 97
- 2023SyncTalk: The Devil is in the Synchronization for Talking Head Synthesiscited by 86
- 2022Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decompositioncited by 81
- 2023Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesiscited by 72
- 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
- 2024Ditto: Motion-Space Diffusion for Controllable Realtime Talking Head Synthesiscited by 41
- 2021Spectral Bias in Practice: The Role of Function Frequency in Generalizationcited by 37
- 2023ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretrainingcited by 24
- 2025InsTaG: Learning Personalized 3D Talking Head from Few-Second Videocited by 18
- 2024MimicTalk: Mimicking a personalized and expressive 3D talking face in minutescited by 16
Built on by
Citing papers per year: 2025: 1.
1 paper.