Context is Everything: Implicit Identification for Dynamics Adaptation
Not on the map. Why?
Abstract (arXiv)
Understanding environment dynamics is necessary for robots to act safely and optimally in the world. In realistic scenarios, dynamics are non-stationary and the causal variables such as environment parameters cannot necessarily be precisely measured or inferred, even during training. We propose Implicit Identification for Dynamics Adaptation (IIDA), a simple method to allow predictive models to adapt to changing environment dynamics. IIDA assumes no access to the true variations in the world and instead implicitly infers properties of the environment from a small amount of contextual data. We demonstrate IIDA's ability to perform well in unseen environments through a suite of simulated experiments on MuJoCo environments and a real robot dynamic sliding task. In general, IIDA significantly reduces model error and results in higher task performance over commonly used methods. Our code and robot videos are at https://bennevans.github.io/iida/
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 30 of its 43 references that are in the map. First posted on arXiv 10 Mar 2022.
Builds on
30 of 43 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2016OpenAI Gymcited by 1,684
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2019Solving Rubik's Cube with a Robot Handcited by 699
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
- 2019Meta-Learning with Implicit Gradientscited by 523
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
18 more
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2019Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variablescited by 372
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2020Learning Agile Robotic Locomotion Skills by Imitating Animalscited by 229
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 225
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 208
- 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 203
- 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 202
- 2017Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Graspingcited by 138
- 2016EPOpt: Learning Robust Neural Network Policies Using Model Ensemblescited by 136
- 2017Preparing for the Unknown: Learning a Universal Policy with Online System Identificationcited by 129
- 2020Context-aware Dynamics Model for Generalization in Model-Based Reinforcement Learningcited by 95
- 2021Evolving Reinforcement Learning Algorithmscited by 48
- 2019Environment Probing Interaction Policiescited by 39
- 2020Model-Based Meta-Reinforcement Learning for Flight with Suspended Payloadscited by 27
- 2015One-Shot Learning of Manipulation Skills with Online Dynamics Adaptation and Neural Network Priorscited by 26
- 2020Fast Online Adaptation in Robotics through Meta-Learning Embeddings of Simulated Priorscited by 21
- 2018Reinforcement learning for non-prehensile manipulation: Transfer from simulation to physical systemcited by 15
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 6; 2025: 9; 2026: 5.
26 papers.
Sort:
By area:
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulationcited by 52
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 42
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulationcited by 42
- 2023The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objectscited by 40
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulationcited by 22
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfercited by 17
- 2022Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Controlcited by 13
- 2022That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulationcited by 12
- 2024Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identificationscited by 10
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesiscited by 9
- 2025Dynamics-Aligned Latent Imagination in Contextual World Models for Zero-Shot Generalizationcited by 5
14 more
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videoscited by 4
- 2023Moving Forward by Moving Backward: Embedding Action Impact over Action Semanticscited by 3
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrationscited by 3
- 2024Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learningcited by 2
- 2024Residual Learning and Context Encoding for Adaptive Offline-to-Online Reinforcement Learningcited by 2
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulationcited by 2
- 2022Open-Ended Diverse Solution Discovery with Regulated Behavior Patterns for Cross-Domain Adaptationcited by 1
- 2025Beyond Context: Large Language Models' Failure to Grasp Users' Intentcited by 1
- 2026DADP: Domain Adaptive Diffusion Policycited by 1
- 2026Contextual Intelligence The Next Leap for Reinforcement Learningcited by 1
- 2024One-shot World Models Using a Transformer Trained on a Synthetic Priorcited by 0
- 2025AD-NODE: Adaptive Dynamics Learning with Neural ODEs for Mobile Robots Controlcited by 0
- 2026MATE: Solving Contextual Markov Decision Processes with Memory of Accumulated Transition Embeddingscited by 0
- 2026Dynamic Context Scheduling: Learning Beyond the Static Universecited by 0
- 2026Dynamic Context Scheduling: Learning Beyond the Static Universe21 Aug 2026
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulation15 Jul 2026
- 2026MATE: Solving Contextual Markov Decision Processes with Memory of Accumulated Transition Embeddings17 May 2026
- 2026Contextual Intelligence The Next Leap for Reinforcement Learning17 Feb 2026
- 2026DADP: Domain Adaptive Diffusion Policy3 Feb 2026
- 2025Beyond Context: Large Language Models' Failure to Grasp Users' Intent24 Dec 2025
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos11 Nov 2025
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis24 Oct 2025
- 2025AD-NODE: Adaptive Dynamics Learning with Neural ODEs for Mobile Robots Control6 Oct 2025
- 2025Dynamics-Aligned Latent Imagination in Contextual World Models for Zero-Shot Generalization27 Aug 2025
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrations24 Aug 2025
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulation23 Apr 2025
14 more
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation31 Mar 2025
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos23 Mar 2025
- 2024Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications27 Oct 2024
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling24 Oct 2024
- 2024One-shot World Models Using a Transformer Trained on a Synthetic Prior21 Sep 2024
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation10 Jul 2024
- 2024Residual Learning and Context Encoding for Adaptive Offline-to-Online Reinforcement Learning12 Jun 2024
- 2024Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learning15 Apr 2024
- 2023The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects1 Jun 2023
- 2023Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics24 Apr 2023
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfer9 Feb 2023
- 2022Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Control23 Oct 2022
- 2022That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulation3 Oct 2022
- 2022Open-Ended Diverse Solution Discovery with Regulated Behavior Patterns for Cross-Domain Adaptation24 Sep 2022
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulationcited by 22
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesiscited by 9
- 2025Dynamics-Aligned Latent Imagination in Contextual World Models for Zero-Shot Generalizationcited by 5
- 2024One-shot World Models Using a Transformer Trained on a Synthetic Priorcited by 0
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis24 Oct 2025
- 2025Dynamics-Aligned Latent Imagination in Contextual World Models for Zero-Shot Generalization27 Aug 2025
- 2025PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulation23 Apr 2025
- 2024One-shot World Models Using a Transformer Trained on a Synthetic Prior21 Sep 2024
- 2026DADP: Domain Adaptive Diffusion Policycited by 1
- 2026DADP: Domain Adaptive Diffusion Policy3 Feb 2026
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulationcited by 52
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 42
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulationcited by 42
- 2023The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objectscited by 40
- 2023AdaptSim: Task-Driven Simulation Adaptation for Sim-to-Real Transfercited by 17
- 2022Active Learning of Discrete-Time Dynamics for Uncertainty-Aware Model Predictive Controlcited by 13
- 2022That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulationcited by 12
- 2024Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identificationscited by 10
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videoscited by 4
- 2023Moving Forward by Moving Backward: Embedding Action Impact over Action Semanticscited by 3
- 2024Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learningcited by 2
12 most cited of 18 All 18 (JSON)
- 2026Dynamic Context Scheduling: Learning Beyond the Static Universe21 Aug 2026
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulation15 Jul 2026
- 2026MATE: Solving Contextual Markov Decision Processes with Memory of Accumulated Transition Embeddings17 May 2026
- 2026Contextual Intelligence The Next Leap for Reinforcement Learning17 Feb 2026
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos11 Nov 2025
- 2025AD-NODE: Adaptive Dynamics Learning with Neural ODEs for Mobile Robots Control6 Oct 2025
- 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation31 Mar 2025
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos23 Mar 2025
- 2024Dynamics as Prompts: In-Context Learning for Sim-to-Real System Identifications27 Oct 2024
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling24 Oct 2024
- 2024AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation10 Jul 2024
- 2024Inferring Behavior-Specific Context Improves Zero-Shot Generalization in Reinforcement Learning15 Apr 2024
12 newest of 18 All 18 (JSON)