mlsanityData to 14 Oct 2026

RedOne: Revealing Domain-specific LLM Post-Training in Social Networking Services

arXiv 2507.10605 ↗First posted 13 Jul 2025cs.LG cs.AI cs.SIcited by 6

Not on the map. Why?

Abstract (arXiv)

As a primary medium for modern information dissemination, social networking services (SNS) have experienced rapid growth, which has proposed significant challenges for platform content management and interaction quality improvement. Recently, the development of large language models (LLMs) has offered potential solutions but existing studies focus on isolated tasks, which not only encounter diminishing benefit from the data scaling within individual scenarios but also fail to flexibly adapt to diverse real-world context. To address these challenges, we introduce RedOne, a domain-specific LLM designed to break the performance bottleneck of single-task baselines and establish a comprehensive foundation for the SNS. RedOne was developed through a three-stage training strategy consisting of continue pretraining, supervised fine-tuning, and preference optimization, using a large-scale real-world dataset. Through extensive experiments, RedOne maintains strong general capabilities, and achieves an average improvement up to 14.02% across 8 major SNS tasks and 7.56% in SNS bilingual evaluation benchmark, compared with base models. Furthermore, through online testing, RedOne reduced the exposure rate in harmful content detection by 11.23% and improved the click page rate in post-view search by 14.95% compared with single-tasks finetuned baseline models. These results establish RedOne as a robust domain-specific LLM for SNS, demonstrating excellent generalization across various tasks and promising applicability in real-world scenarios.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 43 of its 79 references that are in the map. First posted on arXiv 13 Jul 2025.

Builds on

43 of 79 references.

References · 43

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  6. 2021Program Synthesis with Large Language Modelscited by 3,637
  7. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  8. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
  9. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  10. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  11. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  12. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
31 more
  1. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  2. 2023LIMA: Less Is More for Alignmentcited by 1,100
  3. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  4. 2023BloombergGPT: A Large Language Model for Financecited by 939
  5. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
  6. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  7. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
  8. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 560
  9. 2025LIMO: Less is More for Reasoningcited by 498
  10. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 449
  11. 2023Llemma: An Open Language Model For Mathematicscited by 388
  12. 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 223
  13. 2019SemEval-2017 Task 4: Sentiment Analysis in Twittercited by 210
  14. 2023Evaluating the Performance of Large Language Models on GAOKAO Benchmarkcited by 186
  15. 2024RegMix: Data Mixture as Regression for Language Model Pre-trainingcited by 177
  16. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  17. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
  18. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
  19. 2025Infinity Instruct: Scaling Instruction Selection and Synthesis to Enhance Language Modelscited by 50
  20. 2023OceanGPT: A Large Language Model for Ocean Science Taskscited by 43
  21. 2024CompassJudger-1: All-in-one Judge Model Helps Model Evaluation and Evolutioncited by 42
  22. 2024A Continued Pretrained LLM Approach for Automatic Medical Note Generationcited by 30
  23. 2023ChatHome: Development and Evaluation of a Domain-Specific Language Model for Home Renovationcited by 25
  24. 2024FinLlama: Financial Sentiment Classification for Algorithmic Trading Applicationscited by 23
  25. 2024PLLaMa: An Open-source Large Language Model for Plant Sciencecited by 22
  26. 2024MetaIE: Distilling a Meta Model from LLM for All Kinds of Information Extraction Taskscited by 14
  27. 2024SocialGPT: Prompting LLMs for Social Relation Reasoning via Greedy Segment Optimizationcited by 14
  28. 2024WanJuan-CC: A Safe and High-Quality Open-sourced English Webtext Datasetcited by 10
  29. 2024Can Large Language Models Detect Rumors on Social Media?cited by 9
  30. 2024Uncovering Latent Arguments in Social Media Messaging by Employing LLMs-in-the-Loop Strategycited by 9
  31. 2024Self-Emotion Blended Dialogue Generation in Social Simulation Agentscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SNS-Bench-VL: Benchmarking Multimodal Large Language Models in Social Networking Services
  2. 2025Redefining Machine Translation on Social Network Services with Large Language Models
  3. 2024Legilimens: Practical and Unified Content Moderation for Large Language Model Services
  4. 2026Are Open-Weight LLMs Ready for Social Media Moderation? A Comparative Study on Bluesky
  5. 2025Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages
  6. 2024Rethinking Scale: The Efficacy of Fine-Tuned Open-Source LLMs in Large-Scale Reproducible Social Science Research
  7. 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  8. 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark