Implicit Neural Representations of Individual Behavior
Not on the map. Why?
Abstract (arXiv)
We study policy representation learning from unlabeled multi-policy behavioral data. Each episode is generated by a fixed policy, but policy labels are unavailable. This setting appears in robotics play, demonstrations, games, racing, and other datasets where heterogeneous behaviors are mixed without annotations. We introduce Behavioral INR, a self-supervised generative model that adapts implicit neural representations (INRs) from vision to behavior. Instead of mapping coordinates to RGB values, Behavioral INR represents a policy as a state-action function mapping states to subsequent actions. An episode-level latent modulates this function through FiLM layers, yielding a generative prior over policies and allowing policy identity to be inferred without supervision. Because INRs treat each datapoint as samples from an underlying function, the same model naturally accommodates variable episode lengths and different sampling granularities, as in vision INRs with different image resolutions. We also define policy-level out-of-distribution (OOD) shifts along state-distribution and action-distribution axes, which arise when policies overlap in states or actions but are not captured by standard behavioral OOD settings based only on new agents or environments. We evaluate on synthetic Gaussian random field data, MuJoCo demonstrations with controlled OOD splits, and real-world chess, Formula 1 racing, robotics, and Seek-Avoid datasets. Behavioral INR most consistently improves policy identifiability in the hardest continuous state-action settings, especially when longer episodes, more policies, and OOD splits reduce the usefulness of marginal shortcuts; amortized history encoders remain competitive when policy identity can be recovered from symbolic repetition or low-dimensional action statistics. We release code and checkpoints.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 66 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
50 of 66 references.
References · 50
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2019Invariant Risk Minimizationcited by 1,854
- 2016Generative Adversarial Imitation Learningcited by 1,597
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
38 more
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2018Off-Policy Deep Reinforcement Learning without Explorationcited by 1,241
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 496
- 2019Learning Latent Plans from Playcited by 316
- 2018Neural Processescited by 311
- 2016Variational Deep Embedding: An Unsupervised and Generative Approach to Clusteringcited by 220
- 2017DART: Noise Injection for Robust Imitation Learningcited by 191
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
- 2020PLAS: Latent Action Space for Offline Reinforcement Learningcited by 133
- 2019Imitation Learning from Imperfect Demonstrationcited by 114
- 2020Learning Latent Representations to Influence Multi-Agent Interactioncited by 93
- 2022Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrationscited by 89
- 2022Implicit Neural Representations for Variable Length Human Motion Generationcited by 61
- 2021ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mindcited by 58
- 2020Agent Modelling under Partial Observability for Deep Reinforcement Learningcited by 57
- 2018Self-Consistent Trajectory Autoencoder: Hierarchical Reinforcement Learning with Trajectory Embeddingscited by 52
- 2018Learning Policy Representations in Multiagent Systemscited by 48
- 2019Learning to Score Behaviors for Guided Policy Optimizationcited by 34
- 2023Hierarchical Imitation Learning with Vector Quantized Modelscited by 15
- 2024Make-An-Agent: A Generalizable Policy Network Generator with Behavior-Prompted Diffusioncited by 14
- 2020Multi-Agent Interactions Modeling with Correlated Policiescited by 13
- 2022Reward-Free Policy Space Compression for Reinforcement Learningcited by 6
- 2022PAnDR: Fast Adaptation to New Environments from Offline Experiences via Decoupling Policy and Environment Representationscited by 6
- 2024Measuring Policy Distance for Multi-Agent Reinforcement Learningcited by 4
- 2024WARPD: World model Assisted Reactive Policy Diffusioncited by 4
- 2025Towards Balanced Behavior Cloning from Imbalanced Datasetscited by 4
- 2025From Parameters to Behaviors: Unsupervised Compression of the Policy Spacecited by 4
- 2025Adaptively Coordinating with Novel Partners via Learned Latent Strategiescited by 4
- 2025On Learning Informative Trajectory Embeddings for Imitation, Classification and Regressioncited by 3
- 2023Contrastive learning-based agent modeling for deep reinforcement learningcited by 2
- 2024Neural Trajectory Model: Implicit Neural Trajectory Representation for Trajectories Generationcited by 1
- 2025Modeling Latent Partner Strategies for Adaptive Zero-Shot Human-Agent Collaborationcited by 1
- 2026Unsupervised Behavioral Compression: Learning Low-Dimensional Policy Manifolds through State-Occupancy Matchingcited by 1
Built on by
Not cited yet.