mlsanityData to 7 Oct 2026

From Imitation to Discrimination: Progressive Curriculum Learning for Robust Web Navigation

arXiv 2604.12666 ↗First posted 14 Apr 2026cs.LG cs.CL cs.HCcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Text-based web agents offer computational efficiency for autonomous web navigation, yet developing robust agents remains challenging due to the noisy and heterogeneous nature of real-world HTML. Standard Supervised Fine-Tuning (SFT) approaches fail in two critical dimensions: they lack discrimination capabilities to reject plausible but incorrect elements in densely populated pages, and exhibit limited generalization to unseen website layouts. To address these challenges, we introduce the Triton dataset (590k instances) and a progressive training curriculum. Triton is constructed via Structural-Semantic Hard Negative Mining, which explicitly mines topologically similar distractors, and a Dual-Agent Consensus pipeline that synthesizes diverse cross-domain tasks with strict verification. Building upon this foundation, our progressive curriculum produces three models: Triton-SFT-32B for basic imitation, Triton-ORPO-32B for robust discrimination via Odds Ratio Preference Optimization, and Triton-GRPO-32B for long-horizon consistency through Group Relative Policy Optimization. Empirical evaluation on Mind2Web demonstrates that Triton-GRPO-32B achieves state-of-the-art performance among open-source models with 58.7% Step Success Rate, surpassing GPT-4.5 (42.4%) and Claude-4.5 (41.4%) by over 16%, validating that specialized data curriculum outweighs raw parameter scale for web navigation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 19 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

12 of 19 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024GPT-4V(ision) is a Generalist Web Agent, if Grounded3 Jan
  2. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun

Other references · 10

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  6. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
  7. 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 282
  8. 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
  9. 2023You Only Look at Screens: Multimodal Chain-of-Action Agentscited by 185
  10. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Multimodal Web Navigation with Instruction-Finetuned Foundation Models
  2. 2026OpAgent: Operator Agent for Web Navigation
  3. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agent
  4. 2026WebChallenger: A Reliable and Efficient Generalist Web Agent
  5. 2026SynWeaver: Website-Prior Task and Trajectory Co-Synthesis for Web Agents
  6. 2024Navigating WebAI: Training Agents to Complete Web Tasks with Large Language Models and Reinforcement Learning
  7. 2024OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization
  8. 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites