{"list":"other","total":67,"rows":[{"id":"2210.03629","title":"ReAct: Synergizing Reasoning and Acting in Language Models","created":"2022-10-06","cited_by_count":8695},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2305.20050","title":"Let's Verify Step by Step","created":"2023-05-31","cited_by_count":3789},{"id":"2108.07732","title":"Program Synthesis with Large Language Models","created":"2021-08-16","cited_by_count":3637},{"id":"2310.06770","title":"SWE-bench: Can Language Models Resolve Real-World GitHub Issues?","created":"2023-10-10","cited_by_count":3373},{"id":"2308.11432","title":"A Survey on Large Language Model based Autonomous Agents","created":"2023-08-22","cited_by_count":2242},{"id":"2307.16789","title":"ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs","created":"2023-07-31","cited_by_count":1947},{"id":"2406.12045","title":"$\\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains","created":"2024-06-17","cited_by_count":1402},{"id":"2305.15334","title":"Gorilla: Large Language Model Connected with Massive APIs","created":"2023-05-24","cited_by_count":1332},{"id":"2311.12983","title":"GAIA: a benchmark for General AI Assistants","created":"2023-11-21","cited_by_count":1128},{"id":"2307.07924","title":"ChatDev: Communicative Agents for Software Development","created":"2023-07-16","cited_by_count":919},{"id":"2404.13501","title":"A Survey on the Memory Mechanism of Large Language Model based Agents","created":"2024-04-21","cited_by_count":634},{"id":"2503.13657","title":"Why Do Multi-Agent LLM Systems Fail?","created":"2025-03-17","cited_by_count":604},{"id":"2310.08491","title":"Prometheus: Inducing Fine-grained Evaluation Capability in Language Models","created":"2023-10-12","cited_by_count":575},{"id":"2405.01535","title":"Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models","created":"2024-05-02","cited_by_count":446},{"id":"2505.06120","title":"LLMs Get Lost In Multi-Turn Conversation","created":"2025-05-09","cited_by_count":429},{"id":"2412.15204","title":"LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks","created":"2024-12-19","cited_by_count":379},{"id":"2402.04788","title":"MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark","created":"2024-02-07","cited_by_count":372},{"id":"2410.02736","title":"Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge","created":"2024-10-03","cited_by_count":368},{"id":"2310.17631","title":"JudgeLM: Fine-tuned Large Language Models are Scalable Judges","created":"2023-10-26","cited_by_count":367},{"id":"2412.21139","title":"Training Software Engineering Agents and Verifiers with SWE-Gym","created":"2024-12-30","cited_by_count":336},{"id":"2402.14762","title":"MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues","created":"2024-02-22","cited_by_count":250},{"id":"2410.10934","title":"Agent-as-a-Judge: Evaluate Agents with Agents","created":"2024-10-14","cited_by_count":238},{"id":"2305.15066","title":"GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and Benchmarking","created":"2023-05-24","cited_by_count":210},{"id":"2503.16416","title":"Survey on Evaluation of LLM-based Agents","created":"2025-03-20","cited_by_count":204},{"id":"2104.02145","title":"What Will it Take to Fix Benchmarking in Natural Language Understanding?","created":"2021-04-05","cited_by_count":203},{"id":"2307.10928","title":"FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets","created":"2023-07-20","cited_by_count":201},{"id":"2407.12883","title":"BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval","created":"2024-07-16","cited_by_count":158},{"id":"2407.15711","title":"AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?","created":"2024-07-22","cited_by_count":158},{"id":"2410.01257","title":"HelpSteer2-Preference: Complementing Ratings with Preferences","created":"2024-10-02","cited_by_count":130},{"id":"2406.17419","title":"Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA","created":"2024-06-25","cited_by_count":122},{"id":"2004.06063","title":"BLEU might be Guilty but References are not Innocent","created":"2020-04-13","cited_by_count":110},{"id":"2405.04776","title":"Chain of Thoughtlessness? An Analysis of CoT in Planning","created":"2024-05-08","cited_by_count":103},{"id":"2410.06992","title":"SWE-Bench+: Enhanced Coding Benchmark for LLMs","created":"2024-10-09","cited_by_count":99},{"id":"2403.18771","title":"CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists","created":"2024-03-27","cited_by_count":94},{"id":"2406.05761","title":"The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models","created":"2024-06-09","cited_by_count":93},{"id":"2401.17167","title":"Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios","created":"2024-01-30","cited_by_count":86},{"id":"2308.05960","title":"BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents","created":"2023-08-11","cited_by_count":84},{"id":"2407.20859","title":"Breaking Agents: Compromising Autonomous LLM Agents Through Malfunction Amplification","created":"2024-07-30","cited_by_count":81},{"id":"2406.16264","title":"One Thousand and One Pairs: A \"novel\" challenge for long-context language models","created":"2024-06-24","cited_by_count":80},{"id":"2501.18099","title":"Learning to Plan & Reason for Evaluation with Thinking-LLM-as-a-Judge","created":"2025-01-30","cited_by_count":78},{"id":"2408.13006","title":"Systematic Evaluation of LLM-as-a-Judge in LLM Alignment Tasks: Explainable Metrics and Diverse Prompt Templates","created":"2024-08-23","cited_by_count":72},{"id":"2410.14923","title":"Imprompter: Tricking LLM Agents into Improper Tool Use","created":"2024-10-19","cited_by_count":68},{"id":"2503.02068","title":"Interactive Debugging and Steering of Multi-Agent AI Systems","created":"2025-03-03","cited_by_count":68},{"id":"2309.08172","title":"LASER: LLM Agent with State-Space Exploration for Web Navigation","created":"2023-09-15","cited_by_count":66},{"id":"2408.02544","title":"Caution for the Environment: Multimodal LLM Agents are Susceptible to Environmental Distractions","created":"2024-08-05","cited_by_count":56},{"id":"2404.13207","title":"STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Bases","created":"2024-04-19","cited_by_count":55},{"id":"2504.15253","title":"Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators","created":"2025-04-21","cited_by_count":44},{"id":"2312.03815","title":"LLM as OS, Agents as Apps: Envisioning AIOS, Agents and the AIOS-Agent Ecosystem","created":"2023-12-06","cited_by_count":38},{"id":"2404.18001","title":"LLMParser: An Exploratory Study on Using Large Language Models for Log Parsing","created":"2024-04-27","cited_by_count":32},{"id":"2411.01747","title":"DynaSaur: Large Language Agents Beyond Predefined Actions","created":"2024-11-04","cited_by_count":32},{"id":"2502.12532","title":"CityEQA: A Hierarchical LLM Agent on Embodied Question Answering Benchmark in City Space","created":"2025-02-18","cited_by_count":32},{"id":"2406.08723","title":"ECBD: Evidence-Centered Benchmark Design for NLP","created":"2024-06-13","cited_by_count":28},{"id":"2408.16090","title":"EPO: Hierarchical LLM Agents with Environment Preference Optimization","created":"2024-08-28","cited_by_count":28},{"id":"2410.05495","title":"Self-rationalization improves LLM as a fine-grained judge","created":"2024-10-07","cited_by_count":27},{"id":"2504.15909","title":"Synergizing RAG and Reasoning: A Systematic Review","created":"2025-04-22","cited_by_count":27},{"id":"2410.14582","title":"Do LLMs estimate uncertainty well in instruction-following?","created":"2024-10-18","cited_by_count":26},{"id":"2503.15620","title":"Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings","created":"2025-03-19","cited_by_count":24},{"id":"2411.13547","title":"ToolScan: A Benchmark for Characterizing Errors in Tool-Use LLMs","created":"2024-11-20","cited_by_count":18},{"id":"2405.02178","title":"Assessing and Verifying Task Utility in LLM-Powered Applications","created":"2024-05-03","cited_by_count":16},{"id":"2405.12689","title":"Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Text","created":"2024-05-21","cited_by_count":16},{"id":"2502.00677","title":"LLM-based event log analysis techniques: A survey","created":"2025-02-02","cited_by_count":16},{"id":"2412.14140","title":"GLIDER: Grading LLM Interactions and Decisions using Explainable Ranking","created":"2024-12-18","cited_by_count":14},{"id":"2503.06745","title":"Beyond Black-Box Benchmarking: Observability, Analytics, and Optimization of Agentic Systems","created":"2025-03-09","cited_by_count":14},{"id":"2503.19193","title":"Browsing Lost Unformed Recollections: A Benchmark for Tip-of-the-Tongue Search and Reasoning","created":"2025-03-24","cited_by_count":7},{"id":"2503.20263","title":"L4: Diagnosing Large-scale LLM Training Failures via Automated Log Analysis","created":"2025-03-26","cited_by_count":6},{"id":"2305.12280","title":"Contextualizing Argument Quality Assessment with Relevant Knowledge","created":"2023-05-20","cited_by_count":4}],"next_cursor":null}