mlsanityData to 7 Oct 2026

Five Fatal Assumptions: Why T-Shirt Sizing Systematically Fails for AI Projects

arXiv 2602.17734 ↗First posted 18 Feb 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Agile estimation techniques, particularly T-shirt sizing, are widely used in software development for their simplicity and utility in scoping work. However, when we apply these methods to artificial intelligence initiatives -- especially those involving large language models (LLMs) and multi-agent systems -- the results can be systematically misleading. This paper shares an evidence-backed analysis of five foundational assumptions we often make during T-shirt sizing. While these assumptions usually hold true for traditional software, they tend to fail in AI contexts: (1) linear effort scaling, (2) repeatability from prior experience, (3) effort-duration fungibility, (4) task decomposability, and (5) deterministic completion criteria. Drawing on recent research into multi-agent system failures, scaling principles, and the inherent unreliability of multi-turn conversations, we show how AI development breaks these rules. We see this through non-linear performance jumps, complex interaction surfaces, and "tight coupling" where a small change in data cascades through the entire stack. To help teams navigate this, we propose Checkpoint Sizing: a more human-centric, iterative approach that uses explicit decision gates where scope and feasibility are reassessed based on what we learn during development, rather than what we assumed at the start. This paper is intended for engineering managers, technical leads, and product owners responsible for planning and delivering AI initiatives.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 18 Feb 2026.

Builds on

9 of 17 references.

References · 9

  1. 2020Scaling Laws for Neural Language Modelscited by 6,411
  2. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  3. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  4. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  5. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
  6. 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 151
  7. 2025Towards a Science of Scaling Agent Systemscited by 125
  8. 2025An LLM-based multi-agent framework for agile effort estimationcited by 6
  9. 2024Effort and Size Estimation in Software Projects with Large Language Model-based Intelligent Interfacescited by 2

Built on by

Not cited yet.