Primate vision reveals a missing principle for robust dynamic AI
On the map: World models → Embodied and robot world models
Abstract (arXiv)
How does an intelligent visual system combine what objects look like with how they move while remaining robust as appearance changes? We addressed this question by comparing human perception and neural activity in macaque inferior temporal cortex with representations from image- and video-based neural networks spanning recognition, segmentation, optic-flow processing and predictive world modeling. Temporal integration improved object representations, but most video recognition models generalized poorly when appearance was disrupted while motion structure was preserved. Humans and macaque IT remained robust. Notably, predictive world models combined strong cross-appearance generalization with the closest correspondence to IT, outperforming other video-modeling approaches in neural fidelity. Yet no model reproduced the cortical transformation from early appearance-dominated responses toward later appearance-invariant motion coding. These results identify progressive integration of motion into object representations as a principle of robust dynamic vision and implicate predictive learning as a promising route toward realizing this computation in artificial systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 24 Aug 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Reanimating Images using Neural Representations of Dynamic Stimuli
- 2026SCAR: Self-Supervised Continuous Action Representation Learning
- 2026What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction
- 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perception
- 2026Texture Representations in Deep Vision Models: Comparing CNNs, Vision Transformers, and Human Perception
- 2024Continuous Perception Matters: Diagnosing Temporal Integration Failures in Multimodal Models
- 2026Masked Visual Actions for Unified World Modeling
- 2025On the dynamic evolution of CLIP texture-shape bias and its relationship to human alignment and model robustness