IMPACT-CYCLE: A Contract-Based Multi-Agent System for Claim-Level Supervisory Correction of Long-Video Semantic Memory
Not on the map. Why?
Abstract (arXiv)
Correcting errors in long-video understanding is disproportionately costly: existing multimodal pipelines produce opaque, end-to-end outputs that expose no intermediate state for inspection, forcing annotators to revisit raw video and reconstruct temporal logic from scratch. The core bottleneck is not generation quality alone, but the absence of a supervisory interface through which human effort can be proportional to the scope of each error. We present IMPACT-CYCLE, a supervisory multi-agent system that reformulates long-video understanding as iterative claim-level maintenance of a shared semantic memory -- a structured, versioned state encoding typed claims, a claim dependency graph, and a provenance log. Role-specialized agents operating under explicit authority contracts decompose verification into local object-relation correctness, cross-temporal consistency, and global semantic coherence, with corrections confined to structurally dependent claims. When automated evidence is insufficient, the system escalates to human arbitration as the supervisory authority with final override rights; dependency-closure re-verification then ensures correction cost remains proportional to error scope. Experiments on VidOR show substantially improved downstream reasoning (VQA: 0.71 to 0.79) and a 4.8x reduction in human arbitration cost, with workload significantly lower than manual annotation. Code will be released at https://github.com/MKong17/IMPACT_CYCLE.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 53 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
37 of 53 references.
References · 37
- 2023Segment Anythingcited by 8,158
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 820
- 2018Auto-Encoding Scene Graphs for Image Captioningcited by 254
- 2019Action Genome: Actions as Composition of Spatio-temporal Scene Graphscited by 249
- 2017Scene Graph Generation from Objects, Phrases and Region Captionscited by 154
- 2021AGQA: A Benchmark for Compositional Spatio-Temporal Reasoningcited by 120
- 2022Panoptic Scene Graph Generationcited by 114
- 2018Explainable and Explicit Visual Reasoning over Scene Graphscited by 103
- 2021Spatial-Temporal Transformer for Dynamic Scene Graph Generationcited by 95
25 more
- 2021Learning to Generate Scene Graph from Natural Language Supervisioncited by 64
- 2022Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learningcited by 59
- 2019Language-Conditioned Graph Networks for Relational Reasoningcited by 55
- 2024From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Modelscited by 43
- 2022Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipationcited by 41
- 2023Unbiased Scene Graph Generation in Videoscited by 38
- 2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35
- 2024Benchmarking Large Vision-Language Models via Directed Scene Graph for Comprehensive Image Captioningcited by 30
- 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 26
- 2024OED: Towards One-stage End-to-End Dynamic Scene Graph Generationcited by 22
- 2023Learning the What and How of Annotation in Video Object Segmentationcited by 19
- 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answeringcited by 19
- 2023Navigating Open Set Scenarios for Skeleton-based Action Recognitioncited by 17
- 2023Open Scene Understanding: Grounded Situation Recognition Meets Segment Anything for Helping People with Visual Impairmentscited by 13
- 2025Universal Scene Graph Generationcited by 11
- 2025MICA: Multi-Agent Industrial Coordination Assistantcited by 8
- 2025Fine-Grained Captioning of Long Videos through Scene Graph Consolidationcited by 7
- 2025Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph Generationcited by 7
- 2024Towards Unbiased and Robust Spatio-Temporal Scene Graph Generation and Anticipationcited by 6
- 2025Learning 4D Panoptic Scene Graph Generation from Rich 2D Visual Scenecited by 6
- 2025Snap, Segment, Deploy: A Visual Data and Detection Pipeline for Wearable Industrial Assistantscited by 6
- 2025HopaDIFF: Holistic-Partial Aware Fourier Conditioned Diffusion for Referring Human Action Segmentation in Multi-Person Scenarioscited by 5
- 2024Strike the Balance: On-the-Fly Uncertainty based User Interactions for Long-Term Video Object Segmentationcited by 4
- 2025Human-in-the-Loop Local Corrections of 3D Scene Layouts via Infillingcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.