mlsanityData to 14 Oct 2026

R-Log: Incentivizing Log Analysis Capability in LLMs via Reasoning-based Reinforcement Learning

arXiv 2509.25987 ↗First posted 30 Sep 2025cs.SE cs.AIcited by 3

On the map: LLM reasoning → Reinforcement learning for reasoning

Abstract (arXiv)

The growing complexity of log data in modern software systems has prompted the use of Large Language Models (LLMs) for automated log analysis. Current approaches typically rely on direct supervised fine-tuning (SFT) on log-label pairs. However, this exacerbates the domain discrepancy between general-purpose LLMs and specialized log data, causing overfitting. Furthermore, SFT's imbalanced loss computation often allows lengthy contexts to overwhelm critical, concise details in model answers, leading to hallucinations. To address these limitations, we propose R-Log, a novel reasoning-based paradigm that mirrors the structured, step-by-step analytical process of human engineers. This approach enhances generalizability by learning the underlying rules behind conclusions. We further employ Reinforcement Learning (RL) to optimize the model within a simulated O&M environment, thereby reducing hallucinations by directly rewarding correct outcomes. R-Log is first cold-started on a curated dataset of 2k+ reasoning trajectories, guided by 13 strategies from manual O&M practices, to establish an initial reasoning capability. This ability is then refined via RL using a joint reward function. Empirical evaluations on real-world logs show that R-Log outperforms existing methods across five log analysis tasks, particularly in unseen scenarios (by 228.05%). We also designed R-Log-fast with 5x speedup while keeping 93% of the efficacy.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning for reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 72 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

19 of 72 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning22 Jan

Other references · 18

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  6. 2024DeepSeek-V3 Technical Reportcited by 811
  7. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 223
  8. 2025S*: Test Time Scaling for Code Generationcited by 98
  9. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 83
  10. 2020Loghub: A Large Collection of System Log Datasets for AI-driven Log Analyticscited by 70
  11. 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learningcited by 21
  12. 2025ThinkFL: Self-Refining Failure Localization for Microservice Systems via Reinforcement Fine-Tuningcited by 18
6 more
  1. 2021UniLog: Deploy One Model and Specialize it for All Log Analysis Taskscited by 11
  2. 2024LLMs Faithfully and Iteratively Compute Answers During CoT: A Systematic Analysis With Multi-step Arithmeticscited by 11
  3. 2025Domaino1s: Guiding LLM Reasoning for Explainable Answers in High-Stakes Domainscited by 11
  4. 2020Summarizing Unstructured Logs in Online Servicescited by 5
  5. 2024Taming Text-to-Image Synthesis for Novices: User-centric Prompt Generation via Multi-turn Guidancecited by 4
  6. 2025Enhancing Interpretability in Software Change Management with Chain-of-Thought Reasoningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective
  2. 2025Reshaping Reasoning in LLMs: A Theoretical Analysis of RL Training Dynamics through Pattern Selection
  3. 2025LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysis
  4. 2025Part I: Tricks or Traps? A Deep Dive into RL for LLM Reasoning
  5. 2025RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMs
  6. 2025Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecycle
  7. 2026Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation
  8. 2024RLSF: Fine-tuning LLMs via Symbolic Feedback