Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlife
Not on the map. Why?
Abstract (arXiv)
Individual-level wildlife identification often suffers from data scarcity, as varying observations of the same animal under diverse poses, viewpoints, and motions are rarely available. Image-to-video (I2V) generation offers a promising way to mitigate this limitation by synthesizing additional observations from a single reference image. However, existing I2V models mainly emphasize global layout, semantics, and motion, and therefore often fail to preserve fine-grained local appearance cues that distinguish one wildlife individual from another, such as fur texture, stripe boundaries, spot configurations, and contour transitions. We observe that these identity-critical cues are closely related to high-frequency information. To address this challenge, we propose WildIcon, a high-frequency-guided I2V framework for wildlife individual consistency. Specifically, WildIcon introduces a frequency-aware identity encoding branch that extracts individual-specific high-frequency cues from the reference image. Combined with isolated foreground information, the resulting identity tokens are then injected into cross-attention blocks as identity conditioning. Building on a frozen backbone with lightweight identity adaptation, WildIcon preserves fine-grained identity cues visible in the reference image while retaining the motion controllability and semantic fidelity of the base I2V model. In addition, to support the training and evaluation of wildlife individual-consistent I2V, we construct WildlifeVid, a wildlife-centric video dataset with high-quality, temporally coherent clips and individual-level identity labels. Experiments on I2V generation and downstream animal re-identification (ReID) show that WildIcon achieves stronger individual consistency than existing baselines, and that its filtered outputs can serve as useful candidate training augmentations for downstream ReID.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 74 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
48 of 74 references.
References · 48
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025DINOv3cited by 1,414
36 more
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2020First Order Motion Model for Image Animationcited by 704
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2018Deep Facial Expression Recognition: A Surveycited by 270
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2018Unsupervised Learning of Object Landmarks through Conditional Image Generationcited by 114
- 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
- 2023Human Motion Generation: A Surveycited by 96
- 2017Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networkscited by 89
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2018Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Datacited by 46
- 2022Deep Frequency Filtering for Domain Generalizationcited by 43
- 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understandingcited by 36
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
- 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunitiescited by 22
- 2024Adaptive High-Frequency Transformer for Diverse Wildlife Re-Identificationcited by 10
- 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 9
- 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generationcited by 8
- 2025MetaWild: A Multimodal Dataset for Animal Re-Identification with Environmental Metadatacited by 7
- 2025Let Your Video Listen to Your Music!cited by 3
- 2026Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfercited by 3
- 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generatorscited by 2
Built on by
Not cited yet.