mlsanityData to 7 Oct 2026

Learning Long Short-Term Intention within Human Daily Behaviors

arXiv 2504.07597 ↗First posted 10 Apr 2025cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In the domain of autonomous household robots, it is of utmost importance for robots to understand human behaviors and provide appropriate services. This requires the robots to possess the capability to analyze complex human behaviors and predict the true intentions of humans. Traditionally, humans are perceived as flawless, with their decisions acting as the standards that robots should strive to align with. However, this raises a pertinent question: What if humans make mistakes? In this research, we present a unique task, termed "long short-term intention prediction". This task requires robots can predict the long-term intention of humans, which aligns with human values, and the short term intention of humans, which reflects the immediate action intention. Meanwhile, the robots need to detect the potential non-consistency between the short-term and long-term intentions, and provide necessary warnings and suggestions. To facilitate this task, we propose a long short-term intention model to represent the complex intention states, and build a dataset to train this intention model. Then we propose a two-stage method to integrate the intention model for robots: i) predicting human intentions of both value-based long-term intentions and action-based short-term intentions; and 2) analyzing the consistency between the long-term and short-term intentions. Experimental results indicate that the proposed long short-term intention model can assist robots in comprehending human behavioral patterns over both long-term and short-term durations, which helps determine the consistency between long-term and short-term intentions of humans.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 36 references that are in the map. First posted on arXiv 10 Apr 2025.

Builds on

13 of 36 references.

References · 13

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  5. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
  6. 2021iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Taskscited by 191
  7. 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 131
  8. 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
  9. 2019Oops! Predicting Unintentional Action in Videocited by 82
  10. 2020LEMMA: A Multi-view Dataset for Learning Multi-agent Multi-task Activitiescited by 46
  11. 2024On the Emergence of Symmetrical Realitycited by 8
  12. 2019Symmetrical Reality: Toward a Unified Framework for Physical and Virtual Realitycited by 4
1 more
  1. 2024Neighbor-Environment Observer: An Intelligent Agent for Immersive Working Companionshipcited by 2

Built on by

Not cited yet.