mlsanityData to 7 Oct 2026

Learning When to Act: Interval-Aware Reinforcement Learning with Predictive Temporal Structure

arXiv 2603.22384 ↗First posted 23 Mar 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous agents operating in continuous environments must decide not only what to do, but when to act. We introduce a lightweight adaptive temporal control system that learns the optimal interval between cognitive ticks from experience, replacing ad hoc biologically inspired timers with a principled learned policy. The policy state is augmented with a predictive hyperbolic spread signal (a "curvature signal" shorthand) derived from hyperbolic geometry: the mean pairwise Poincare distance among n sampled futures embedded in the Poincare ball. High spread indicates a branching, uncertain future and drives the agent to act sooner; low spread signals predictability and permits longer rest intervals. We further propose an interval-aware reward that explicitly penalises inefficiency relative to the chosen wait time, correcting a systematic credit-assignment failure of naive outcome-based rewards in timing problems. We additionally introduce a joint spatio-temporal embedding (ATCPG-ST) that concatenates independently normalised state and position projections in the Poincare ball; spatial trajectory divergence provides an independent timing signal unavailable to the state-only variant (ATCPG-SO). This extension raises mean hyperbolic spread (kappa) from 1.88 to 3.37 and yields a further 5.8 percent efficiency gain over the state-only baseline. Ablation experiments across five random seeds demonstrate that (i) learning is the dominant efficiency factor (54.8 percent over no-learning), (ii) hyperbolic spread provides significant complementary gain (26.2 percent over geometry-free control), (iii) the combined system achieves 22.8 percent efficiency over the fixed-interval baseline, and (iv) adding spatial position information to the spread embedding yields an additional 5.8 percent.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 23 Mar 2026.

Builds on

13 of 35 references.

References · 13

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
  3. 2018Hyperbolic Neural Networkscited by 393
  4. 2018Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometrycited by 261
  5. 2025AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systemscited by 86
  6. 2025Boosting LLM Reasoning via Spontaneous Self-Correctioncited by 18
  7. 2026Learning When to Act or Refuse: Guarding Agentic Reasoning Models for Safe Multi-Step Tool Usecited by 7
  8. 2026When to Act, Ask, or Learn: Uncertainty-Aware Policy Steeringcited by 4
  9. 2025Consensus-based Decentralized Multi-agent Reinforcement Learning for Random Access Network Optimizationcited by 3
  10. 2024Internalized Self-Correction for Large Language Modelscited by 2
  11. 2025Hierarchical Decentralized Multi-Agent Coordination with Privacy-Preserving Knowledge Sharing: Extending AgentNet for Scalable Autonomous Systemscited by 2
  12. 2025Scale-free weak output synchronization of multi-agent systems with adaptive protocolscited by 1
1 more
  1. 2026Cascade-Aware Multi-Agent Routing: Spatio-Temporal Sidecars and Geometry-Switchingcited by 1

Built on by

Not cited yet.