Pistis Technical Report
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models also fits: MLLM training and visual instruction tuning
also in 1 more
Abstract (arXiv)
We introduce the Pistis model family, comprising 27B- and 9B-parameter multimodal large language models built on Qwen3.6 and Qwen3.5, respectively, and developed through a general and scalable post-training framework. The framework first establishes a strong foundation through large-scale multimodal supervised fine-tuning (SFT). Building on this SFT foundation, we propose Interleaved Distillation and Reinforcement Learning (IDRL), a novel post-training paradigm that tightly integrates on-policy distillation and reinforcement learning within a single training loop. By alternating between the two objectives, rather than optimizing either in isolation or combining them in a static joint loss, IDRL enables more effective knowledge transfer, greater optimization stability, and more precise credit assignment for long-horizon agentic trajectories, leading to stronger performance while mitigating common capability trade-offs. At both model scales, the framework produces two specialized variants: Pistis-Thinking, designed to strengthen deep multimodal reasoning, and Pistis-Agentic, which additionally incorporates agentic trajectory data to support long-horizon planning, iterative reasoning, and tool use. Pistis-Agentic is particularly strong in multimodal search. Both scales outperform their corresponding base models. Beyond model-parameter optimization, we further introduce Pistis-Auto-Harnessing (PAH), a system-level method that automatically improves the agent's inference harness through iterative optimization. Experiments demonstrate that PAH enhances the model performance without updating the model parameters or increasing the interaction budget.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 33 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
29 of 33 references.
References · 29
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
17 more
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2024AFlow: Automating Agentic Workflow Generationcited by 395
- 2024Automated Design of Agentic Systemscited by 360
- 2026Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipecited by 262
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 240
- 2025Thyme: Think Beyond Imagescited by 160
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
- 2025WebWatcher: Breaking New Frontier of Vision-Language Deep Research Agentcited by 114
- 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 98
- 2025Soft Adaptive Policy Optimizationcited by 89
- 2025Kwai Keye-VL 1.5 Technical Reportcited by 68
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
- 2025VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoocited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Process-Supervised Reinforcement Learning for Interactive Multimodal Tool-Use Agents
- 2026SOD: Step-wise On-policy Distillation for Small Language Model Agents
- 2026Privileged Information Distillation for Language Models
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2026Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning
- 2025Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoning
- 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning