mlsanityData to 7 Oct 2026

RedOne 2.0: Rethinking Domain-specific LLM Post-Training in Social Networking Services

arXiv 2511.07070 ↗First posted 10 Nov 2025cs.AI cs.LGcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

As a key medium for human interaction and information exchange, social networking services (SNS) pose unique challenges for large language models (LLMs): heterogeneous workloads, fast-shifting norms and slang, and multilingual, culturally diverse corpora that induce sharp distribution shift. Supervised fine-tuning (SFT) can specialize models but often triggers a ``seesaw'' between in-distribution gains and out-of-distribution robustness, especially for smaller models. To address these challenges, we introduce RedOne 2.0, an SNS-oriented LLM trained with a progressive, RL-prioritized post-training paradigm designed for rapid and stable adaptation. The pipeline consist in three stages: (1) Exploratory Learning on curated SNS corpora to establish initial alignment and identify systematic weaknesses; (2) Targeted Fine-Tuning that selectively applies SFT to the diagnosed gaps while mixing a small fraction of general data to mitigate forgetting; and (3) Refinement Learning that re-applies RL with SNS-centric signals to consolidate improvements and harmonize trade-offs across tasks. Across various tasks spanning three categories, our 4B scale model delivers an average improvements about 2.41 over the 7B sub-optimal baseline. Additionally, RedOne 2.0 achieves average performance lift about 8.74 from the base model with less than half the data required by SFT-centric method RedOne, evidencing superior data efficiency and stability at compact scales. Overall, RedOne 2.0 establishes a competitive, cost-effective baseline for domain-specific LLMs in SNS scenario, advancing capability without sacrificing robustness.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 48 of its 84 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

48 of 84 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
  2. 2025Qwen3 Technical Report14 May
  3. 2024DeepSeek-V3 Technical Report27 Dec
  4. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools18 Jun

Other references · 44

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  8. 2024GPT-4o System Cardcited by 4,467
  9. 2021Program Synthesis with Large Language Modelscited by 3,509
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  11. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  12. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
32 more
  1. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  2. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  3. 2023BloombergGPT: A Large Language Model for Financecited by 923
  4. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  5. 2022Galactica: A Large Language Model for Sciencecited by 736
  6. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
  7. 2024Phi-4 Technical Reportcited by 675
  8. 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 454
  9. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  10. 2023Llemma: An Open Language Model For Mathematicscited by 385
  11. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
  12. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
  13. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
  14. 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 182
  15. 2023Understanding Catastrophic Forgetting in Language Models via Implicit Inferencecited by 138
  16. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 136
  17. 2024Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsalcited by 114
  18. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 80
  19. 2023LLM-Rec: Personalized Recommendation via Prompting Large Language Modelscited by 77
  20. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 49
  21. 2024SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Modelscited by 38
  22. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  23. 2025RL Fine-Tuning Heals OOD Forgetting in SFTcited by 27
  24. 2024What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detectioncited by 24
  25. 2025OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understandingcited by 17
  26. 2025DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practicecited by 13
  27. 2023Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Datacited by 11
  28. 2024Large Language Models for Social Networks: Applications, Challenges, and Solutionscited by 11
  29. 2024NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalismcited by 8
  30. 2025Redefining Machine Translation on Social Network Services with Large Language Modelscited by 6
  31. 2025RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Servicescited by 6
  32. 2025dots.llm1 Technical Reportcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Balancing Enhancement, Harmlessness, and General Capabilities: Enhancing Conversational LLMs with Direct RLHF
  2. 2025SNS-Bench-VL: Benchmarking Multimodal Large Language Models in Social Networking Services
  3. 2024Rethinking Scale: The Efficacy of Fine-Tuned Open-Source LLMs in Large-Scale Reproducible Social Science Research
  4. 2024WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback
  5. 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark
  6. 2024A Framework for Fine-Tuning LLMs using Heterogeneous Feedback
  7. 2023Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuning
  8. 2025CUPID: Evaluating Personalized and Contextualized Alignment of LLMs from Interactions