Neural Force Field: Few-shot Learning of Generalized Physical Reasoning
Not on the map. Why?
Abstract (arXiv)
Physical reasoning is a remarkable human ability that enables rapid learning and generalization from limited experience. Current AI models, despite extensive training, still struggle to achieve similar generalization, especially in Out-of-distribution (OOD) settings. This limitation stems from their inability to abstract core physical principles from observations. A key challenge is developing representations that can efficiently learn and generalize physical dynamics from minimal data. Here we present Neural Force Field (NFF), a framework extending Neural Ordinary Differential Equation (NODE) to learn complex object interactions through force field representations, which can be efficiently integrated through an Ordinary Differential Equation (ODE) solver to predict object trajectories. Unlike existing approaches that rely on discrete latent spaces, NFF captures fundamental physical concepts such as gravity, support, and collision in continuous explicit force fields. Experiments on three challenging physical reasoning tasks demonstrate that NFF, trained with only a few examples, achieves strong generalization to unseen scenarios. This physics-grounded representation enables efficient forward-backward planning and rapid adaptation through interactive refinement. Our work suggests that incorporating physics-inspired representations into learning systems can help bridge the gap between artificial and human physical reasoning capabilities.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 70 references that are in the map. First posted on arXiv 13 Feb 2025.
Builds on
42 of 70 references.
References · 42
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,061
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2020Object-Centric Learning with Slot Attentioncited by 876
30 more
- 2019Hamiltonian Neural Networkscited by 712
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2020Lagrangian Neural Networkscited by 398
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 184
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2025Do generative video models understand physical principles?cited by 161
- 2019Graph Neural Ordinary Differential Equationscited by 154
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 147
- 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
- 2020On Second Order Behaviour in Augmented Neural ODEscited by 68
- 2020Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sensecited by 62
- 2019Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoningcited by 61
- 2022Physics Informed Neural Fields for Smoke Reconstruction with Sparse Datacited by 52
- 2020Learning Long-term Visual Dynamics with Region Proposal Interaction Networkscited by 44
- 2022Learning rigid dynamics with face interaction graph networkscited by 43
- 2022Learning Physical Dynamics with Subequivariant Graph Neural Networkscited by 39
- 2022Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactionscited by 34
- 2015Joint Inference of Groups, Events and Human Roles in Aerial Videoscited by 30
- 2020Generalization to New Actions in Reinforcement Learningcited by 25
- 2020Few-shot Visual Reasoning with Meta-analogical Contrastive Learningcited by 19
- 2024Slot State Space Modelscited by 17
- 2023I-PHYRE: Interactive Physical Reasoningcited by 15
- 2024Learning rigid-body simulators over implicit shapes for large-scale scenes and visioncited by 12
- 2022On the Learning Mechanisms in Physical Reasoningcited by 11
- 2023Latent Field Discovery In Interacting Dynamical Systems With Neural Fieldscited by 7
- 2024Few-Shot Task Learning through Inverse Generative Modelingcited by 4
- 2023X-VoE: Measuring eXplanatory Violation of Expectation in Physical Eventscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI
- 2026Decoupled Physical Modeling and Execution for Physics Reasoning
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fields
- 2025Uncovering Spontaneous Physics Representations in In-Context Learning
- 2024Discover physical concepts and equations with machine learning
- 2024LLMPhy: Parameter-Identifiable Physical Reasoning Combining Large Language Models and Physics Engines
- 2026Goal Force: Teaching Video Models To Accomplish Physics-Conditioned Goals
- 2025Inducing Causal World Models in LLMs for Zero-Shot Physical Reasoning