mlsanityData to 7 Oct 2026

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems

arXiv 2606.24937 ↗First posted 22 Jun 2026cs.AI cs.CL cs.IRcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

The Hitchhiker's Guide to Agentic AI is a comprehensive practitioner's reference for building autonomous AI systems, covering the full stack from first principles to production deployment. The central thesis: building great agentic systems requires understanding every layer of the pipeline, not just one. The book opens with the LLM substrate, covering transformer architecture, GPU systems, training and fine-tuning (SFT, LoRA, MoE), model compression, and inference optimization, as essential foundations. It then develops the alignment and reasoning layer: RLHF, PPO, DPO and its variants, GRPO, reward modeling, and RL for large reasoning models including chain-of-thought and test-time scaling. The second half is devoted to agentic AI proper: agentic training and trajectory-based RL, RAG and Agentic RAG, memory systems (in-context, external, episodic, and semantic), agent harness design, loop engineering, graph-based orchestration, and a taxonomy of agent design patterns covering security, red teaming, and gateway infrastructure. Inter-agent coordination is covered in depth: the Model Context Protocol (MCP), agent skills and tool use, the Agent-to-Agent (A2A) protocol, and multi-agent architectures spanning centralized, decentralized, and hierarchical topologies. The book concludes with agent development frameworks, agentic UI design, evaluation methodology (non-deterministic evaluation, reasoning collapse, LLM-as-Judge), production deployment, and the regulatory environment (EU AI Act, California SB 942) as an engineering requirement. Each chapter pairs theory with implementation guidance, executable notebooks, and references to the primary literature.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 262 of its 466 references that are in the map. First posted on arXiv 22 Jun 2026.

Builds on

262 of 466 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents13 Aug
  2. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct

Other references · 260

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2022Training language models to follow instructions with human feedbackcited by 15,712
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2017Proximal Policy Optimization Algorithmscited by 14,441
  8. 2024The Llama 3 Herd of Modelscited by 14,192
  9. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  10. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  11. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  12. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
38 more
  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  5. 2025Qwen3 Technical Reportcited by 8,195
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2020Scaling Laws for Neural Language Modelscited by 6,411
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  10. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  11. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  12. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  13. 2016Layer Normalizationcited by 5,579
  14. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  15. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  16. 2024Qwen2.5 Technical Reportcited by 4,713
  17. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  18. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  19. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  20. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  21. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  22. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  23. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  24. 2017Deep reinforcement learning from human preferencescited by 3,846
  25. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  26. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  27. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  28. 2023Let's Verify Step by Stepcited by 3,598
  29. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  30. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  31. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  32. 2020Longformer: The Long-Document Transformercited by 3,362
  33. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  34. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  35. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  36. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  37. 2023Mistral 7Bcited by 3,065
  38. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997

50 most cited of 260 All 260 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Agentic Design Patterns: A System-Theoretic Framework
  2. 2026AgentDrive: An Open Benchmark Dataset for Agentic AI Reasoning with LLM-Generated Scenarios in Autonomous Systems
  3. 2026Position: Agentic AI System Is a Foreseeable Pathway to AGI
  4. 2026Agentick: A Unified Benchmark for General Sequential Decision-Making Agents
  5. 2025Agentic AI Frameworks: Architectures, Protocols, and Design Challenges
  6. 2025Formalizing the Safety, Security, and Functional Properties of Agentic AI Systems
  7. 2026Architecting Agentic Communities using Design Patterns
  8. 2026Agentic Artificial Intelligence (AI): Architectures, Taxonomies, and Evaluation of Large Language Model Agents