mlsanityData to 7 Oct 2026

ECHO: Event-Augmented Context with Hindsight and Outlook for Wrist-Only Manipulation

arXiv 2609.34893 ↗First posted 28 Sep 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning-based manipulation policies relying on RGB cameras often suffer from degraded observations under extreme exposure. Event cameras mitigate this degradation by asynchronously detecting pixel-level intensity changes to offer a high dynamic range. However, their observations heavily depend on camera placement, as fixed cameras miss static scene content while wrist-mounted camera motion causes previously visited regions to leave the field of view. To address these spatial-temporal limitations, we present ECHO (Event-augmented Context with Hindsight and Outlook), a wrist-only latent world action model that encodes wrist events into compact motion representations to provide temporal and spatial context for policy reasoning. Specifically, ECHO utilizes a pretrained event encoder to explain visual-feature changes between frames. Its hindsight module preserves the gripper trajectory with past event stream as addressable off-camera context. Concurrently, the outlook module introduces learnable event foresight queries supervised to anticipate the event window for future actions, enabling the policy to predict upcoming scene changes. Evaluated on wrist-only RLBench tasks, ECHO outperforms RGB and RGB+event baselines by 20.6 and 12.0 percentage points under normal lighting, and by 14.6 and 11.3 points under severe exposure drops, respectively, while also surpassing RGB references using a third-person camera. Real-world experiments with a wrist-mounted event camera validate that ECHO outperforms RGB-only and RGB+event baselines across multiple tasks under both nominal and severely dark lighting. Project page is at https://echo-wam.github.io/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 43 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

37 of 43 references.

References · 37

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  7. 2019Event-based Vision: A Surveycited by 1,010
  8. 2024Genie: Generative Interactive Environmentscited by 706
  9. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  10. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  11. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  12. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
25 more
  1. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  2. 2024Latent Action Pretraining from Videoscited by 302
  3. 2025Motus: A Unified Latent Action World Modelcited by 231
  4. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  5. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulationcited by 149
  6. 2023Learning to Act without Actionscited by 116
  7. 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
  8. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  9. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Modelscited by 58
  10. 2019EVDodgeNet: Deep Dynamic Obstacle Dodging with Event Camerascited by 46
  11. 2026Learning Latent Action World Models In The Wildcited by 42
  12. 2025CLAM: Continuous Latent Action Models for Robot Learning from Unlabeled Demonstrationscited by 39
  13. 2025CoMo: Learning Continuous Latent Motion from Internet Videos for Scalable Robot Learningcited by 37
  14. 2024EventGPT: Event Stream Understanding with Multimodal Large Language Modelscited by 27
  15. 2021Representation Learning for Event-based Visuomotor Policiescited by 19
  16. 2025REASSEMBLE: A Multimodal Dataset for Contact-rich Robotic Assembly and Disassemblycited by 14
  17. 2021Real-Time Grasping Strategies Using Event Cameracited by 8
  18. 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 7
  19. 2026Memory Retrieval in Visuomotor Policies for Long-Horizon Robot Controlcited by 7
  20. 2026Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulationcited by 6
  21. 2025SEBVS: Synthetic Event-based Visual Servoing for Robot Navigation and Manipulationcited by 5
  22. 2026E-VLA: Event-Augmented Vision-Language-Action Model for Dark and Blurred Scenescited by 4
  23. 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Modelcited by 2
  24. 2023Event-based Vision for Early Prediction of Manipulation Actionscited by 1
  25. 2026AtlasVLA: Persistent World-Ego State Modeling for Vision-Language-Action Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Action-Effect Memory Pretraining for Robot Manipulation
  2. 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies
  3. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
  4. 2026FutureDuet: Decoupling Observation Access from Future Supervision in World Action Models
  5. 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation
  6. 2026ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
  7. 2026Rethinking Camera Choice: An Empirical Study on Fisheye Camera Properties in Robotic Manipulation
  8. 2026FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation