AnyviewMeter: Adapting Robotic Reward Models with Camera Geometry and Multi-View Attention
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment also fits: Reward modeling and RLHF
Abstract (arXiv)
Robotic reward models evaluate task execution from visual observations, but their predictions can change with camera viewpoint and occlusion even when the underlying task state is unchanged. Adapting a pretrained reward model to a local task therefore requires accounting for how that task is observed. We introduce AnyviewMeter, a geometry-conditioned adaptation framework for robotic reward models that represent task progress as a scalar reward signal. It combines low-rank fine-tuning with token-aligned Plucker rays and synchronous block attention: ray conditioning incorporates camera geometry into visual features and attention queries and keys, while block attention fuses synchronized views inside the pretrained decoder. The framework supports both single-view reward prediction and joint multi-view evaluation through parameter-efficient adaptation of a pretrained Robometer model. On PickCube, single-view adaptation improves progress prediction in every camera group and reduces mean absolute error under a changed field of view by approximately 21% relative to RGB fine-tuning. Across simulated manipulation tasks, joint multi-view prediction reduces progress error by 41-69% compared with averaging single-view RGB predictions and improves temporal ordering in approximately 88% of task-camera groups. On real tasks with fixed and wrist-mounted cameras, mean absolute error decreases by approximately 21% relative to averaged RGB fine-tuning. These results support camera geometry and joint visual evidence as useful components of task-specific robotic reward adaptation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 29 of its 35 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
29 of 35 references.
References · 29
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
- 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 180
17 more
- 2019Temporal Cycle-Consistency Learningcited by 151
- 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 147
- 2024Stop Regressing: Training Value Functions via Classification for Scalable Deep RLcited by 136
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2025Cameras as Relative Positional Encodingcited by 94
- 2024Vision Language Models are In-Context Value Learnerscited by 84
- 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 78
- 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
- 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learningcited by 66
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 51
- 2026RoboReward: General-Purpose Vision-Language Reward Models for Roboticscited by 46
- 2025Robo-Dopamine: General Process Reward Modeling for High-Precision Robotic Manipulationcited by 37
- 2025Do You Know Where Your Camera Is? View-Invariant Policy Learning with Camera Conditioningcited by 14
- 2026RynnValue: Scaling Robotic Value Foundation Models with Temporal Distancecited by 5
- 2026SCoPE: Sightline-Coordinate Positional Encoding for Video Diffusion Transformerscited by 3
- 2026Position: Good Embodied Reward Models Need Bad Behavior Datacited by 2
- 2026Cross-View Action Consistency for Camera-Robust Vision-Language-Action Policiescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rewarding DINO: Predicting Dense Rewards with Vision Foundation Models
- 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Robotics
- 2026CriticHack: Evaluating Visual Rewards Under Robot Policy Optimization
- 2025Act2Goal: From World Model To General Goal-conditioned Policy
- 2026Robo-Dopamine 2.0: History-Conditioned and OOD-Aware Process Reward Modeling for Robotic Manipulation
- 2025Subtask-Aware Visual Reward Learning from Segmented Demonstrations
- 2026RARM: Confidence-Gated Progress Reward Modeling for RL in Manipulation
- 2026Large Reward Models: Generalizable Online Robot Reward Generation with Vision-Language Models