mlsanityData to 14 Oct 2026

Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlife

arXiv 2610.05587 ↗First posted 4 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Individual-level wildlife identification often suffers from data scarcity, as varying observations of the same animal under diverse poses, viewpoints, and motions are rarely available. Image-to-video (I2V) generation offers a promising way to mitigate this limitation by synthesizing additional observations from a single reference image. However, existing I2V models mainly emphasize global layout, semantics, and motion, and therefore often fail to preserve fine-grained local appearance cues that distinguish one wildlife individual from another, such as fur texture, stripe boundaries, spot configurations, and contour transitions. We observe that these identity-critical cues are closely related to high-frequency information. To address this challenge, we propose WildIcon, a high-frequency-guided I2V framework for wildlife individual consistency. Specifically, WildIcon introduces a frequency-aware identity encoding branch that extracts individual-specific high-frequency cues from the reference image. Combined with isolated foreground information, the resulting identity tokens are then injected into cross-attention blocks as identity conditioning. Building on a frozen backbone with lightweight identity adaptation, WildIcon preserves fine-grained identity cues visible in the reference image while retaining the motion controllability and semantic fidelity of the base I2V model. In addition, to support the training and evaluation of wildlife individual-consistent I2V, we construct WildlifeVid, a wildlife-centric video dataset with high-quality, temporally coherent clips and individual-level identity labels. Experiments on I2V generation and downstream animal re-identification (ReID) show that WildIcon achieves stronger individual consistency than existing baselines, and that its filtered outputs can serve as useful candidate training augmentations for downstream ReID.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 74 references that are in the map. First posted on arXiv 4 Oct 2026.

Builds on

48 of 74 references.

References · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2025DINOv3cited by 1,414
36 more
  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  3. 2020First Order Motion Model for Image Animationcited by 704
  4. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 686
  5. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  6. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  7. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  8. 2018Deep Facial Expression Recognition: A Surveycited by 270
  9. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
  10. 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
  11. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  12. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  13. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  14. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  15. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
  16. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
  17. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
  18. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
  19. 2018Unsupervised Learning of Object Landmarks through Conditional Image Generationcited by 114
  20. 2022Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understandingcited by 103
  21. 2023Human Motion Generation: A Surveycited by 96
  22. 2017Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networkscited by 89
  23. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
  24. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
  25. 2018Past, Present, and Future Approaches Using Computer Vision for Animal Re-Identification from Camera Trap Datacited by 46
  26. 2022Deep Frequency Filtering for Domain Generalizationcited by 43
  27. 2023MammalNet: A Large-scale Video Benchmark for Mammal Recognition and Behavior Understandingcited by 36
  28. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
  29. 2025Text Data Augmentation for Large Language Models: A Comprehensive Survey of Methods, Challenges, and Opportunitiescited by 22
  30. 2024Adaptive High-Frequency Transformer for Diverse Wildlife Re-Identificationcited by 10
  31. 2025Web-Scale Collection of Video Data for 4D Animal Reconstructioncited by 9
  32. 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generationcited by 8
  33. 2025MetaWild: A Multimodal Dataset for Animal Re-Identification with Environmental Metadatacited by 7
  34. 2025Let Your Video Listen to Your Music!cited by 3
  35. 2026Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion Transfercited by 3
  36. 2025When Distillation Breaks Motion Control: Restoring Generative Trajectories for Fast Video Generatorscited by 2

Built on by

Not cited yet.