mlsanityData to 7 Oct 2026

Addressing and Visualizing Misalignments in Human Task-Solving Trajectories

arXiv 2409.14191 ↗First posted 21 Sep 2024cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding misalignments in human task-solving trajectories is crucial for enhancing AI models trained to closely mimic human reasoning. This study categorizes such misalignments into three types: (1) lack of functions to express intent, (2) inefficient action sequences, and (3) incorrect intentions that cannot solve the task. To address these issues, we first formalize and define these three misalignment types in a unified framework. We then propose a heuristic algorithm to detect misalignments in ARCTraj trajectories and analyze their impact hierarchically and quantitatively. We also present an intention estimation method based on our formalism that infers missing alignment between user actions and intentions. Through trajectory alignment, we experimentally demonstrate that AI models trained on human task-solving trajectories improve performance in mimicking human reasoning. Based on hierarchical analysis and experiments, we highlight the importance of trajectory-intention alignment and demonstrate the effectiveness of intention-aligned training.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 33 references that are in the map. First posted on arXiv 21 Sep 2024.

Builds on

10 of 33 references.

References · 10

  1. 2017Deep reinforcement learning from human preferencescited by 3,846
  2. 2018A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progresscited by 294
  3. 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 97
  4. 2017Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a surveycited by 90
  5. 2021Fast and flexible: Human program induction in abstract reasoning taskscited by 33
  6. 2024H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmarkcited by 32
  7. 2023Unraveling the ARC Puzzle: Mimicking Human Solutions with Object-Centric Decision Transformercited by 12
  8. 2023Solving ARC visual analogies with neural embeddings and vector arithmetic: A generalized methodcited by 8
  9. 2024ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learningcited by 7
  10. 2024Enhancing Analogical Reasoning in the Abstraction and Reasoning Corpus via Model-Based RLcited by 2

Built on by

Not cited yet.