CCR-Bench: A Comprehensive Benchmark for Evaluating LLMs on Complex Constraints, Control Flows, and Real-World Cases
Not on the map. Why?
Abstract (arXiv)
Enhancing the ability of large language models (LLMs) to follow complex instructions is critical for their deployment in real-world applications. However, existing evaluation methods often oversimplify instruction complexity as a mere additive combination of atomic constraints, failing to adequately capture the high-dimensional complexity arising from the intricate interplay of content and format, logical workflow control, and real-world applications. This leads to a significant gap between current evaluation practices and practical demands. To bridge this gap, we introduce CCR-Bench, a novel benchmark designed to assess LLMs' adherence to complex instructions. CCR-Bench is characterized by: (1) deep entanglement of content and formatting requirements in task specifications; (2) instructions that involve intricate task decomposition, conditional reasoning, and procedural planning; and (3) evaluation samples derived entirely from real-world industrial scenarios. Extensive experiments on CCR-Bench demonstrate that even state-of-the-art models exhibit substantial performance deficiencies, clearly quantifying the gap between current LLM capabilities and the demands of realworld instruction understanding. We believe that CCR-Bench offers a more rigorous and realistic evaluation framework, advancing the development of LLMs toward the next generation of models capable of understanding and executing complex tasks in industrial applications.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 19 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
9 of 19 references.
References · 9
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2023Evaluating Large Language Models on Controlled Generation Taskscited by 73
- 2024CFBench: A Comprehensive Constraints-Following Benchmark for LLMscited by 67
- 2025IHEval: Evaluating Language Models on Following the Instruction Hierarchycited by 53
- 2025Infinity Instruct: Scaling Instruction Selection and Synthesis to Enhance Language Modelscited by 50
- 2024FlowBench: Revisiting and Benchmarking Workflow-Guided Planning for LLM-based Agentscited by 40
- 2024IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimizationcited by 31
- 2025WildIFEval: Instruction Following in the Wildcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.