RedOne 2.0: Rethinking Domain-specific LLM Post-Training in Social Networking Services
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
As a key medium for human interaction and information exchange, social networking services (SNS) pose unique challenges for large language models (LLMs): heterogeneous workloads, fast-shifting norms and slang, and multilingual, culturally diverse corpora that induce sharp distribution shift. Supervised fine-tuning (SFT) can specialize models but often triggers a ``seesaw'' between in-distribution gains and out-of-distribution robustness, especially for smaller models. To address these challenges, we introduce RedOne 2.0, an SNS-oriented LLM trained with a progressive, RL-prioritized post-training paradigm designed for rapid and stable adaptation. The pipeline consist in three stages: (1) Exploratory Learning on curated SNS corpora to establish initial alignment and identify systematic weaknesses; (2) Targeted Fine-Tuning that selectively applies SFT to the diagnosed gaps while mixing a small fraction of general data to mitigate forgetting; and (3) Refinement Learning that re-applies RL with SNS-centric signals to consolidate improvements and harmonize trade-offs across tasks. Across various tasks spanning three categories, our 4B scale model delivers an average improvements about 2.41 over the 7B sub-optimal baseline. Additionally, RedOne 2.0 achieves average performance lift about 8.74 from the base model with less than half the data required by SFT-centric method RedOne, evidencing superior data efficiency and stability at compact scales. Overall, RedOne 2.0 establishes a competitive, cost-effective baseline for domain-specific LLMs in SNS scenario, advancing capability without sacrificing robustness.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 48 of its 84 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
48 of 84 references.
Closest ancestors · 4
Same direction, newest first
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug
- 2025Qwen3 Technical Report14 May
- 2024DeepSeek-V3 Technical Report27 Dec
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools18 Jun
Other references · 44
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2024GPT-4o System Cardcited by 4,467
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,767
32 more
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 722
- 2024Phi-4 Technical Reportcited by 675
- 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 454
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
- 2023Llemma: An Open Language Model For Mathematicscited by 385
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
- 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
- 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 182
- 2023Understanding Catastrophic Forgetting in Language Models via Implicit Inferencecited by 138
- 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 136
- 2024Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsalcited by 114
- 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 80
- 2023LLM-Rec: Personalized Recommendation via Prompting Large Language Modelscited by 77
- 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 49
- 2024SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Modelscited by 38
- 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
- 2025RL Fine-Tuning Heals OOD Forgetting in SFTcited by 27
- 2024What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detectioncited by 24
- 2025OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understandingcited by 17
- 2025DentVLM: A Multimodal Vision-Language Model for Comprehensive Dental Diagnosis and Enhanced Clinical Practicecited by 13
- 2023Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Datacited by 11
- 2024Large Language Models for Social Networks: Applications, Challenges, and Solutionscited by 11
- 2024NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalismcited by 8
- 2025Redefining Machine Translation on Social Network Services with Large Language Modelscited by 6
- 2025RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Servicescited by 6
- 2025dots.llm1 Technical Reportcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Balancing Enhancement, Harmlessness, and General Capabilities: Enhancing Conversational LLMs with Direct RLHF
- 2025SNS-Bench-VL: Benchmarking Multimodal Large Language Models in Social Networking Services
- 2024Rethinking Scale: The Efficacy of Fine-Tuned Open-Source LLMs in Large-Scale Reproducible Social Science Research
- 2024WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark
- 2024A Framework for Fine-Tuning LLMs using Heterogeneous Feedback
- 2023Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuning
- 2025CUPID: Evaluating Personalized and Contextualized Alignment of LLMs from Interactions