mlsanityData to 7 Oct 2026

First-Person Activity Forecasting with Online Inverse Reinforcement Learning

arXiv 1612.07796 ↗First posted 22 Dec 2016cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

We address the problem of incrementally modeling and forecasting long-term goals of a first-person camera wearer: what the user will do, where they will go, and what goal they seek. In contrast to prior work in trajectory forecasting, our algorithm, DARKO, goes further to reason about semantic states (will I pick up an object?), and future goal states that are far in terms of both space and time. DARKO learns and forecasts from first-person visual observations of the user's daily behaviors via an Online Inverse Reinforcement Learning (IRL) approach. Classical IRL discovers only the rewards in a batch setting, whereas DARKO discovers the states, transitions, rewards, and goals of a user from streaming data. Among other results, we show DARKO forecasts goals better than competing methods in both noisy and ideal settings, and our approach is theoretically and empirically no-regret.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Dec 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2018: 1; 2019: 2; 2020: 2; 2021: 12; 2022: 6; 2023: 3; 2024: 7; 2025: 6; 2026: 1.

40 papers.

Sort:

By area:

  1. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  2. 2021Anticipative Video Transformercited by 197
  3. 2021Ego-Exo: Transferring Visual Representations from Third-person to First-person Videoscited by 98
  4. 2019Third-Person Visual Imitation Learning via Decoupled Hierarchical Controllercited by 73
  5. 2022Real-time Online Video Detection with Temporal Smoothing Transformerscited by 58
  6. 2021Procedure Planning in Instructional Videos via Contextual Modeling and Model-based Policy Learningcited by 53
  7. 2021Human Hands as Probes for Interactive Object Understandingcited by 51
  8. 2021Learning to Anticipate Egocentric Actions by Imaginationcited by 40
  9. 2021Self-Regulated Learning for Egocentric Video Activity Anticipationcited by 32
  10. 2019Interactive Teaching Algorithms for Inverse Reinforcement Learningcited by 24
  11. 2021A Survey on Human-aware Robot Navigationcited by 23
  12. 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
28 more
  1. 2020Inverse Reinforcement Learning with Natural Language Goalscited by 20
  2. 2021SlowFast Rolling-Unrolling LSTMs for Action Anticipation in Egocentric Videoscited by 20
  3. 2025EgoExo-Gen: Ego-centric Video Prediction by Watching Exo-centric Videoscited by 19
  4. 2023Multi-label affordance mapping from egocentric visioncited by 18
  5. 2023Instance Tracking in 3D Scenes from Egocentric Videoscited by 17
  6. 2024EAGLE: Egocentric AGgregated Language-video Enginecited by 16
  7. 2023A Survey on Deep Learning Techniques for Action Anticipationcited by 11
  8. 2024Human Action Anticipation: A Surveycited by 8
  9. 2024FIction: 4D Future Interaction Prediction from Videocited by 8
  10. 2022Egocentric Scene Understanding via Multimodal Spatial Rectifiercited by 7
  11. 2024Uncertainty-boosted Robust Video Activity Anticipationcited by 7
  12. 2024In-Trajectory Inverse Reinforcement Learning: Learn Incrementally Before An Ongoing Trajectory Terminatescited by 7
  13. 2021Learning to Discriminate Information for Online Action Detection: Analysis and Applicationcited by 6
  14. 2025Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Modelscited by 6
  15. 2021Review of Video Predictive Understanding: Early Action Recognition and Future Action Predictioncited by 5
  16. 2022FutureHuman3D: Forecasting Complex Long-Term 3D Human Behavior from Video Observationscited by 5
  17. 2025Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challengescited by 5
  18. 2024Streaming Detection of Queried Event Startcited by 3
  19. 2024From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipationcited by 2
  20. 2022Nonuniqueness and Convergence to Equivalent Solutions in Observer-based Inverse Reinforcement Learningcited by 1
  21. 2018A Framework and Method for Online Inverse Reinforcement Learningcited by 0
  22. 2020Interaction-limited Inverse Reinforcement Learningcited by 0
  23. 2021Understanding in Artificial Intelligencecited by 0
  24. 2021Egocentric Activity Recognition and Localization on a 3D Mapcited by 0
  25. 2025DIV-FF: Dynamic Image-Video Feature Fields For Environment Understanding in Egocentric Videoscited by 0
  26. 2025PACE: A Framework for Learning and Control in Linear Incomplete-Information Differential Gamescited by 0
  27. 2025Peer-Aware Cost Estimation in Nonlinear General-Sum Dynamic Games for Mutual Learning and Intent Inferencecited by 0
  28. 2026Interactive Inverse Reinforcement Learning of Interaction Scenarios via Bi-level Optimizationcited by 0