mlsanityData to 14 Oct 2026

Towards Interactive Intelligence for Digital Humans

arXiv 2512.13674 ↗First posted 15 Dec 2025cs.CV cs.CL cs.GRcited by 10

Not on the map. Why?

Abstract (arXiv)

We introduce Interactive Intelligence, a novel paradigm of digital human that is capable of personality-aligned expression, adaptive interaction, and self-evolution. To realize this, we present Mio (Multimodal Interactive Omni-Avatar), an end-to-end framework composed of five specialized modules: Thinker, Talker, Face Animator, Body Animator, and Renderer. This unified architecture integrates cognitive reasoning with real-time multimodal embodiment to enable fluid, consistent interaction. Furthermore, we establish a new benchmark to rigorously evaluate the capabilities of interactive intelligence. Extensive experiments demonstrate that our framework achieves superior performance compared to state-of-the-art methods across all evaluated dimensions. Together, these contributions move digital humans beyond superficial imitation toward intelligent interaction.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 107 of its 147 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

107 of 147 references.

References · 107

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  11. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  12. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
38 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  3. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  5. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  6. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  7. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  8. 2022Human Motion Diffusion Modelcited by 1,080
  9. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  10. 2016Least Squares Generative Adversarial Networkscited by 1,001
  11. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 780
  12. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  13. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  14. 2020First Order Motion Model for Image Animationcited by 704
  15. 2022High Fidelity Neural Audio Compressioncited by 687
  16. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  17. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 619
  18. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
  19. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  20. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  21. 2023MotionGPT: Human Motion as a Foreign Languagecited by 527
  22. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  23. 2025VACE: All-in-One Video Creation and Editingcited by 479
  24. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  25. 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 463
  26. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  27. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 444
  28. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
  29. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  30. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
  31. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  32. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  33. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 345
  34. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  35. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  36. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  37. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
  38. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272

50 most cited of 107 All 107 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

  1. 2026LPM 1.0: Video-based Character Performance Modelcited by 11
  2. 2026Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Modelscited by 7
  3. 2026ProAct: Harnessing Streaming Motion Generation and Agentic Reasoning for Real-Time Embodied Social Interactioncited by 3
  4. 2026InteracVid: Building a Real Interactive Audio-Visual Response Dataset from Live-Chat Videoscited by 2
  5. 2026UMo: Unified Sparse Motion Modeling for Real-Time Co-Speech Avatarscited by 1
  6. 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?cited by 1
  7. 2026ECHO: Towards Emotionally Appropriate and Contextually Aware Interactive Head Generationcited by 0
  8. 2026Human-Centric Intelligence in the Era of Foundation Models: A Surveycited by 0
  9. 2026Super Star: Towards Streaming Real-time Interactive Agents for Digital Humanscited by 0
  10. 2026What Makes a Social Agent's Interactions Effective? Learning from Verifiable Outcomes in Paired Worldscited by 0