Agents meet OKR: An Object and Key Results Driven Agent System with Hierarchical Self-Collaboration and Self-Evaluation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In this study, we introduce the concept of OKR-Agent designed to enhance the capabilities of Large Language Models (LLMs) in task-solving. Our approach utilizes both self-collaboration and self-correction mechanism, facilitated by hierarchical agents, to address the inherent complexities in task-solving. Our key observations are two-fold: first, effective task-solving demands in-depth domain knowledge and intricate reasoning, for which deploying specialized agents for individual sub-tasks can markedly enhance LLM performance. Second, task-solving intrinsically adheres to a hierarchical execution structure, comprising both high-level strategic planning and detailed task execution. Towards this end, our OKR-Agent paradigm aligns closely with this hierarchical structure, promising enhanced efficacy and adaptability across a range of scenarios. Specifically, our framework includes two novel modules: hierarchical Objects and Key Results generation and multi-level evaluation, each contributing to more efficient and robust task-solving. In practical, hierarchical OKR generation decomposes Objects into multiple sub-Objects and assigns new agents based on key results and agent responsibilities. These agents subsequently elaborate on their designated tasks and may further decompose them as necessary. Such generation operates recursively and hierarchically, culminating in a comprehensive set of detailed solutions. The multi-level evaluation module of OKR-Agent refines solution by leveraging feedback from all associated agents, optimizing each step of the process. This ensures solution is accurate, practical, and effectively address intricate task requirements, enhancing the overall reliability and quality of the outcome. Experimental results also show our method outperforms the previous methods on several tasks. Code and demo are available at https://okr-agent.github.io/
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 27 of its 33 references that are in the map. First posted on arXiv 28 Nov 2023.
Builds on
27 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May
Other references · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
12 more
- 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
- 2023Large Language Models as Tool Makerscited by 293
- 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 147
- 2023Decision-Oriented Dialogue for Human-AI Collaborationcited by 29
- 2017It Takes Two to Tango: Towards Theory of AI's Mindcited by 11
- 2019Generating Animations from Screenplayscited by 3
- 2023AI based approach to Trailer Generation for Online Educational Coursescited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 0; 2026: 2.
6 papers.
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 81
- 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaborationcited by 26
- 2024Simulating Financial Market via Large Language Model based Agentscited by 25
- 2024AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systemscited by 23
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
- 2026Scene-Aware Memory Discrimination: Deciding Which Personal Knowledge Stayscited by 0
- 2026Scene-Aware Memory Discrimination: Deciding Which Personal Knowledge Stays12 Feb 2026
- 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMs12 Feb 2026
- 2024Simulating Financial Market via Large Language Model based Agents28 Jun 2024
- 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration18 Apr 2024
- 2024Embodied LLM Agents Learn to Cooperate in Organized Teams19 Mar 2024
- 2024AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systems14 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution
- 2026Can Small Agents Collaborate to Beat a Single Large Language Model?
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
- 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration
- 2024Adaptive In-conversation Team Building for Language Model Agents
- 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model
- 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research