Wnuan: Staged Post-Training for Question Answering over Proprietary Enterprise Knowledge
Not on the map. Why?
Abstract (arXiv)
Enterprise question answering requires models to acquire proprietary knowledge without discarding general capabilities. We present Wnuan, a three-stage pipeline that constructs task-oriented supervision from documents, performs supervised fine-tuning with general-data replay, and applies reinforcement learning to residual errors. On the 707-question WnuanBench, the primary 32B route raises acceptable-answer rate (AAR) from 52.76% before adaptation to 80.06% after SFT and 91.51% after RL. Under a matched 100-update protocol, residual-error sampling outperforms full-pool and size-matched random sampling by 3.11 and 2.97 points, respectively. Source-cluster bootstrap intervals remain above zero for both contrasts, and a same-domain validation set preserves the ordering. The general-benchmark average decreases by 5.17 points across the route, concentrated in instruction following. The automatic evaluation ensemble agrees with an authoritative domain expert on 90.5% of a stratified Wnuan-Inst response sample. These results characterize both the gains and the general-capability cost of staged enterprise adaptation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
18 of 32 references.
References · 18
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
- 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 396
- 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
- 2024RAFT: Adapting Language Model to Domain Specific RAGcited by 262
6 more
- 2026The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligencecited by 61
- 2024Instruction-tuned Language Models are Better Knowledge Learnerscited by 55
- 2025Principled Data Selection for Alignment: The Hidden Risks of Difficult Examplescited by 37
- 2025Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation Budgetscited by 17
- 2026DS2-Instruct: Domain-Specific Data Synthesis for Large Language Models Instruction Tuningcited by 4
- 2026MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing Understandingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization
- 2025Knowledge-Augmented Question Error Correction for Chinese Question Answer System with QuestionRAG
- 2026WinSyn: An Automated Pipeline for Realistic Enterprise Question-Answering Evaluation
- 2023Prompt Generate Train (PGT): Few-shot Domain Adaption of Retrieval Augmented Generation Models for Open Book Question-Answering
- 2026Towards Faithful Industrial RAG: A Reinforced Co-adaptation Framework for Advertising QA
- 2025Reinforced Informativeness Optimization for Long-Form Retrieval-Augmented Generation
- 2026GAPD: Gold-Action Policy Distillation for Agentic Reinforcement Learning in Knowledge Base Question Answering
- 2026FinRAG-12B: A Production-Validated Recipe for Grounded Question Answering in Banking