mlsanityData to 14 Oct 2026

CyberJurors: A Multi-Agent Simulation Task for E-Commerce Disputes Verdict

arXiv 2605.28369 ↗First posted 27 May 2026cs.AI cs.SIcited by 1

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

E-commerce platforms have begun recruiting crowdsourced jurors to adjudicate massive volumes of transaction disputes. Unlike formal legal judgment, E-commerce dispute verdicts require grounding pivotal clues from redundant, multi-round, multimodal evidence and making decisions under flexible platform-specific conventions. These characteristics render existing methods insufficient for this scenario. To bridge this gap, we introduce a pioneering task, E-commerce Dispute Verdicts (EDV), and present VerdictBench, a multimodal benchmark comprising 6,000 real-world cases designed to reflect crowdsourced jury decisions. Building upon this, we propose CyberJurors, a multi-agent framework to clarify the dispute logic and regulate the verdict process. At the individual level, Individual Verdict Chain-of-Thought decomposes the EDV task into four structured reasoning stages, enabling fine-grained clue perception and clarifying causal logic between pivotal clues and the dispute focus. At the collective level, Jury Consensus Verdict simulates multi-round discussion and voting among jurors, while incorporating verdict precedents to mitigate cognitive biases toward either disputant. Experiments on VerdictBench show that CyberJurors outperforms state-of-the-art LLMs, MLLMs, and court simulators, while achieving stronger alignment with real-world jury voting patterns. Code and dataset are available at https://github.com/YanhuiS/CyberJurors and https://huggingface.co/datasets/piggi/VerdictBench.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 28 of its 44 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

28 of 44 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Law in Silico: Simulating Legal Society with LLM-Based Agents28 Oct
  2. 2025Chinese Court Simulation with LLM-Based Agent System24 Aug
  3. 2025Debate-Feedback: A Multi-Agent Framework for Efficient Legal Judgment Prediction7 Apr
  4. 2025Multi-Agent Simulator Drives Language Models for Legal Intensive Interaction8 Feb
  5. 2024AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents15 Aug
  6. 2024AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation5 Mar
  7. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulation26 Feb
  8. 2024Systematic Biases in LLM Simulations of Debates6 Feb

Other references · 20

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  3. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  4. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  5. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 742
  6. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
  7. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
  8. 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
  9. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 183
  10. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
  11. 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 117
  12. 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 114
8 more
  1. 2025LLM Agents for Education: Advances and Applicationscited by 59
  2. 2025The Truth Becomes Clearer Through Debate! Multi-Agent Systems with Large Language Models Unmask Fake Newscited by 29
  3. 2025Reinforce LLM Reasoning through Multi-Agent Reflectioncited by 27
  4. 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulationcited by 15
  5. 2025Generative Social Choice: The Next Generationcited by 10
  6. 2025PopSim: Social Network Simulation for Social Media Popularity Predictioncited by 5
  7. 2025DynamiX: Large-Scale Dynamic Social Network Simulatorcited by 2
  8. 2026GASim: A Graph-Accelerated Hybrid Framework for Social Simulationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026JuryFlow: Disagreement-Guided Human-in-the-Loop Multi-Agent Evaluation
  2. 2024Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justice
  3. 2026L-MAD: A Systematic Evaluation of Multi-Agent Debate Structures in Legal Reasoning
  4. 2026AgenticSimLaw: A Juvenile Courtroom Multi-Agent Debate Simulation for Explainable High-Stakes Tabular Decision Making
  5. 2026VERDICT: Verifiable Evolving Reasoning with Directive-Informed Collegial Teams for Legal Judgment Prediction
  6. 2025SAMVAD: A Multi-Agent System for Simulating Judicial Deliberation Dynamics in India
  7. 2026Courtroom-Style Multi-Agent Debate with Progressive RAG and Role-Switching for Controversial Claim Verification
  8. 2026Investigating Multi-Agent Deliberation in Law