mlsanityData to 7 Oct 2026

Agents meet OKR: An Object and Key Results Driven Agent System with Hierarchical Self-Collaboration and Self-Evaluation

arXiv 2311.16542 ↗First posted 28 Nov 2023cs.CVcited by 6

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

In this study, we introduce the concept of OKR-Agent designed to enhance the capabilities of Large Language Models (LLMs) in task-solving. Our approach utilizes both self-collaboration and self-correction mechanism, facilitated by hierarchical agents, to address the inherent complexities in task-solving. Our key observations are two-fold: first, effective task-solving demands in-depth domain knowledge and intricate reasoning, for which deploying specialized agents for individual sub-tasks can markedly enhance LLM performance. Second, task-solving intrinsically adheres to a hierarchical execution structure, comprising both high-level strategic planning and detailed task execution. Towards this end, our OKR-Agent paradigm aligns closely with this hierarchical structure, promising enhanced efficacy and adaptability across a range of scenarios. Specifically, our framework includes two novel modules: hierarchical Objects and Key Results generation and multi-level evaluation, each contributing to more efficient and robust task-solving. In practical, hierarchical OKR generation decomposes Objects into multiple sub-Objects and assigns new agents based on key results and agent responsibilities. These agents subsequently elaborate on their designated tasks and may further decompose them as necessary. Such generation operates recursively and hierarchically, culminating in a comprehensive set of detailed solutions. The multi-level evaluation module of OKR-Agent refines solution by leveraging feedback from all associated agents, optimizing each step of the process. This ensures solution is accurate, practical, and effectively address intricate task requirements, enhancing the overall reliability and quality of the outcome. Experimental results also show our method outperforms the previous methods on several tasks. Code and demo are available at https://okr-agent.github.io/

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 27 of its 33 references that are in the map. First posted on arXiv 28 Nov 2023.

Builds on

27 of 33 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  2. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul
  3. 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks27 May

Other references · 24

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  6. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  8. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  11. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  12. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
12 more
  1. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  2. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  3. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  4. 2023Is ChatGPT a General-Purpose Natural Language Processing Task Solver?cited by 486
  5. 2023Large Language Models as Tool Makerscited by 293
  6. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  7. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  8. 2023Chain of Hindsight Aligns Language Models with Feedbackcited by 147
  9. 2023Decision-Oriented Dialogue for Human-AI Collaborationcited by 29
  10. 2017It Takes Two to Tango: Towards Theory of AI's Mindcited by 11
  11. 2019Generating Animations from Screenplayscited by 3
  12. 2023AI based approach to Trailer Generation for Online Educational Coursescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 0; 2026: 2.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution
  2. 2026Can Small Agents Collaborate to Beat a Single Large Language Model?
  3. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  4. 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration
  5. 2024Adaptive In-conversation Team Building for Language Model Agents
  6. 2026AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration
  7. 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model
  8. 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research