PROGRESSLM: Towards Progress Reasoning in Vision-Language Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Estimating task progress requires reasoning over long-horizon dynamics rather than recognizing static visual content. While modern Vision-Language Models (VLMs) excel at describing what is visible, it remains unclear whether they can infer how far a task has progressed from partial observations. To this end, we introduce Progress-Bench, a benchmark for systematically evaluating progress reasoning in VLMs. Beyond benchmarking, we further explore a human-inspired two-stage progress reasoning paradigm through both training-free prompting and training-based approach based on curated dataset ProgressLM-45K. Experiments on 14 VLMs show that most models are not yet ready for task progress estimation, exhibiting sensitivity to demonstration modality and viewpoint changes, as well as poor handling of unanswerable cases. While training-free prompting that enforces structured progress reasoning yields limited and model-dependent gains, the training-based ProgressLM-3B achieves consistent improvements even at a small model scale, despite being trained on a task set fully disjoint from the evaluation tasks. Further analyses reveal characteristic error patterns and clarify when and why progress reasoning succeeds or fails. Website: https://progresslm.github.io/ProgressLM/
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 62 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
33 of 62 references.
Closest ancestors · 3
Same direction, newest first
- 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sports9 Nov
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents19 Oct
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
Other references · 30
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025Qwen-Image Technical Reportcited by 973
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
- 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 147
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
- 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learningcited by 66
- 2024Image Textualization: An Automatic Framework for Creating Accurate and Detailed Image Descriptionscited by 43
18 more
- 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correctioncited by 37
- 2025SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulationcited by 36
- 2025VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cuescited by 33
- 2025AutoDrive-R2: Incentivizing Reasoning and Self-Reflection Capacity for VLA Model in Autonomous Drivingcited by 32
- 2025DecAlign: Hierarchical Cross-Modal Alignment for Decoupled Multimodal Representation Learningcited by 23
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Toolscited by 23
- 2025FrameMind: Frame-Interleaved Video Reasoning via Reinforcement Learningcited by 20
- 2025Hybrid Reinforcement: When Reward Is Sparse, It's Better to Be Densecited by 19
- 2024Leopard: A Vision Language Model For Text-Rich Multi-Image Taskscited by 18
- 2025DynCIM: Dynamic Curriculum for Imbalanced Multimodal Learningcited by 16
- 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 14
- 2025JailDAM: Jailbreak Detection with Adaptive Memory for Vision-Language Modelcited by 10
- 2025RefineShot: Rethinking Cinematography Understanding with Foundational Skill Evaluationcited by 10
- 2025MRFD: Multi-Region Fusion Decoding with Self-Consistency for Mitigating Hallucinations in LVLMscited by 9
- 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Modelscited by 9
- 2025RoboReflect: A Robotic Reflective Reasoning Framework for Grasping Ambiguous-Condition Objectscited by 4
- 2026Persona-aware and Explainable Bikeability Assessment: A Vision-Language Model Approachcited by 4
- 2026Multimodal Generative Engine Optimization: Rank Manipulation for Vision-Language Model Rankerscited by 3
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 51
- 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Roboticscited by 29
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verificationcited by 19
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulationcited by 8
- 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generationcited by 6
- 2026From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulationcited by 5
- 2026Improving Robotic Generalist Policies via Flow Reversal Steeringcited by 5
- 2026LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videoscited by 2
- 2026IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Toolscited by 0
- 2026PHIRL: Aligning Learned Rewards with Task Progress for Inverse Reinforcement Learningcited by 0
- 2026ARS: Agentic Reward System for Robot Learningcited by 0
- 2026ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Contextcited by 0
1 more
- 2026Video2Skill: From Streaming Experience to Reusable Embodied Skills29 Sep 2026
- 2026ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Context29 Sep 2026
- 2026ARS: Agentic Reward System for Robot Learning28 Sep 2026
- 2026PHIRL: Aligning Learned Rewards with Task Progress for Inverse Reinforcement Learning25 Sep 2026
- 2026LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos27 Jul 2026
- 2026Improving Robotic Generalist Policies via Flow Reversal Steering11 Jun 2026
- 2026IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Tools20 May 2026
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation9 May 2026
- 2026From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulation16 Mar 2026
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisons2 Mar 2026
- 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Robotics22 Feb 2026
- 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generation12 Feb 2026
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 51
- 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Roboticscited by 29
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulationcited by 8
- 2026PHIRL: Aligning Learned Rewards with Task Progress for Inverse Reinforcement Learningcited by 0
- 2026ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Contextcited by 0
- 2026ProgressCompass: Embodied Progress Reward Models Are Lost Without the Right Context29 Sep 2026
- 2026PHIRL: Aligning Learned Rewards with Task Progress for Inverse Reinforcement Learning25 Sep 2026
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation9 May 2026
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisons2 Mar 2026
- 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Robotics22 Feb 2026
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verificationcited by 19
- 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generationcited by 6
- 2026From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulationcited by 5
- 2026From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulation16 Mar 2026
- 2026What if Agents Could Imagine? Reinforcing Open-Vocabulary HOI Comprehension through Generation12 Feb 2026
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification22 Jan 2026
- 2026ARS: Agentic Reward System for Robot Learningcited by 0
- 2026ARS: Agentic Reward System for Robot Learning28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Recurrent Reasoning with Vision-Language Models for Estimating Long-Horizon Embodied Task Progress
- 2025Progress-Think: Semantic Progress Reasoning for Vision-Language Navigation
- 2024UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
- 2026ProgressVLA: Progress-Guided Diffusion Policy for Vision-Language Robotic Manipulation
- 2025Limits and Gains of Test-Time Scaling in Vision-Language Reasoning
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models
- 2025Training Vision-Language Process Reward Models for Test-Time Scaling in Multimodal Reasoning: Key Insights and Lessons Learned
- 2026From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models