Speak for Me: Giving LLMs the Situational Awareness to Participate in a Meeting
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In online meeting delegation, LLM agents fail to recognize when to speak. With no structured way to track stances, coverage, and floor, they miss the moments where they should contribute. Prompt-only delegates stay silent on 51.4% of the absent participant's talking opportunities on the AMI corpus. We present CAPA (Collaborative Agent Predictive Architecture), an architecture for online meeting delegation. A Perceiver updates the meeting state from each observed turn. A Predictor forecasts how the conversation will continue. A Controller decides whether to speak and which proposition to surface. A Generator phrases the chosen contribution in the participant's style. Two judges score the forecast and the action against the next observed turn. A Recalibrator updates the meeting state from those verdicts for future decisions. To evaluate online delegation, we introduce an episode-level protocol that scores whether, when, and what a delegate contributes around the participant's actual idea units. The protocol's schema-constrained LLM judges align with human annotations at Cohen's kappa = 0.71. On 137 AMI meetings, CAPA reduces the silence rate from 51.4% to 2.5%, doubles credited recovery (26.1 --> 52.2), and keeps hallucination at 0.6%. The failure mode shifts from omission to selection, with each residual near-miss attributable to a specific module of the architecture. Mechanism ablations identify the meeting state as the lever that closes the recognition gap, where raw-context scaling alone does not.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 19 of its 40 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
19 of 40 references.
Closest ancestors · 2
Same direction, newest first
- 2025Humanlike Multi-user Agent (HUMA): Designing a Deceptively Human AI Facilitator for Group Chats21 Nov
- 2025Multi-Party Conversational Agents: A Survey24 May
Other references · 17
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
- 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
- 2025Context Length Alone Hurts LLM Performance Despite Perfect Retrievalcited by 127
- 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 84
- 2023A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospectscited by 66
- 2024Multi-User Chat Assistant (MUCA): a Framework Using LLMs to Facilitate Group Conversationscited by 14
- 2023Summaries, Highlights, and Action items: Design, implementation and evaluation of an LLM-powered meeting recap systemcited by 12
- 2024CiteAssist: A System for Automated Preprint Citation and BibTeX Generationcited by 11
5 more
- 2025Think Twice, Generate Once: Safeguarding by Progressive Self-Reflectioncited by 11
- 2024Do LLMs suffer from Multi-Party Hangover? A Diagnostic Approach to Addressee Recognition and Response Selection in Conversationscited by 9
- 2024Tell me what I need to know: Exploring LLM-based (Personalized) Abstractive Multi-Source Meeting Summarizationcited by 9
- 2025Interaction Dynamics as a Reward Signal for LLMscited by 5
- 2025MEETING DELEGATE: Benchmarking LLMs on Attending Meetings on Our Behalfcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Task-Aware Delegation Cues for LLM Agents
- 2025Overhearing LLM Agents: A Survey, Taxonomy, and Roadmap
- 2026MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in Multi-Party Meetings
- 2024SAUCE: Synchronous and Asynchronous User-Customizable Environment for Multi-Agent LLM Interaction
- 2026GroupMemBench: Benchmarking LLM Agent Memory in Multi-Party Conversations
- 2025Time to Talk: LLM Agents for Asynchronous Group Communication in Mafia Games
- 2026ProACT: Towards Breakdown-Aware Proactive Agent in Multi-User Collaboration
- 2026LoSoNA: A Benchmark for Local Social Norm Adaptation in Group Conversations