{"list":"other","total":57,"rows":[{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2305.20050","title":"Let's Verify Step by Step","created":"2023-05-31","cited_by_count":3789},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2303.16634","title":"G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment","created":"2023-03-29","cited_by_count":2276},{"id":"2404.04475","title":"Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators","created":"2024-04-06","cited_by_count":897},{"id":"2308.07201","title":"ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate","created":"2023-08-14","cited_by_count":742},{"id":"2309.00267","title":"RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback","created":"2023-09-01","cited_by_count":625},{"id":"2406.11939","title":"From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline","created":"2024-06-17","cited_by_count":500},{"id":"2408.15240","title":"Generative Verifiers: Reward Modeling as Next-Token Prediction","created":"2024-08-27","cited_by_count":480},{"id":"2405.01535","title":"Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models","created":"2024-05-02","cited_by_count":446},{"id":"2310.17631","title":"JudgeLM: Fine-tuned Large Language Models are Scalable Judges","created":"2023-10-26","cited_by_count":367},{"id":"2410.12784","title":"JudgeBench: A Benchmark for Evaluating LLM-based Judges","created":"2024-10-16","cited_by_count":318},{"id":"2306.17563","title":"Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting","created":"2023-06-30","cited_by_count":307},{"id":"2310.07641","title":"Evaluating Large Language Models at Evaluating Instruction Following","created":"2023-10-11","cited_by_count":302},{"id":"2409.12183","title":"To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning","created":"2024-09-18","cited_by_count":263},{"id":"2406.08673","title":"HelpSteer2: Open-source dataset for training top-performing reward models","created":"2024-06-12","cited_by_count":236},{"id":"2406.04770","title":"WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild","created":"2024-06-07","cited_by_count":218},{"id":"2402.10200","title":"Chain-of-Thought Reasoning Without Prompting","created":"2024-02-15","cited_by_count":210},{"id":"2307.10928","title":"FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets","created":"2023-07-20","cited_by_count":201},{"id":"2308.13387","title":"Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs","created":"2023-08-25","cited_by_count":184},{"id":"2410.16184","title":"RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style","created":"2024-10-21","cited_by_count":176},{"id":"2408.10075","title":"Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning","created":"2024-08-19","cited_by_count":155},{"id":"2405.01724","title":"Large Language Models are Inconsistent and Biased Evaluators","created":"2024-05-02","cited_by_count":153},{"id":"2403.16950","title":"Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators","created":"2024-03-25","cited_by_count":149},{"id":"2312.08358","title":"Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHF","created":"2023-12-13","cited_by_count":133},{"id":"2410.01257","title":"HelpSteer2-Preference: Complementing Ratings with Preferences","created":"2024-10-02","cited_by_count":130},{"id":"2402.14016","title":"Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessment","created":"2024-02-21","cited_by_count":126},{"id":"2410.21333","title":"Mind Your Step (by Step): Chain-of-Thought can Reduce Performance on Tasks where Thinking Makes Humans Worse","created":"2024-10-27","cited_by_count":109},{"id":"2310.15123","title":"Branch-Solve-Merge Improves Large Language Model Evaluation and Generation","created":"2023-10-23","cited_by_count":106},{"id":"2301.08721","title":"Batch Prompting: Efficient Inference with Large Language Model APIs","created":"2023-01-19","cited_by_count":85},{"id":"2312.03748","title":"Applying Large Language Models and Chain-of-Thought for Automatic Scoring","created":"2023-11-30","cited_by_count":69},{"id":"2409.10164","title":"Quantile Regression for Distributional Reward Models in RLHF","created":"2024-09-16","cited_by_count":60},{"id":"2406.15657","title":"FIRST: Faster Improved Listwise Reranking with Single Token Decoding","created":"2024-06-21","cited_by_count":54},{"id":"2402.07314","title":"Online Iterative Reinforcement Learning from Human Feedback with General Preference Model","created":"2024-02-11","cited_by_count":52},{"id":"2410.14632","title":"Diverging Preferences: When do Annotators Disagree and do Models Know?","created":"2024-10-18","cited_by_count":47},{"id":"2410.16256","title":"CompassJudger-1: All-in-one Judge Model Helps Model Evaluation and Evolution","created":"2024-10-21","cited_by_count":42},{"id":"2412.13091","title":"LMUnit: Fine-grained Evaluation with Natural Language Unit Tests","created":"2024-12-17","cited_by_count":33},{"id":"2410.03742","title":"Beyond Scalar Reward Model: Learning Generative Judge from Preference Data","created":"2024-10-01","cited_by_count":32},{"id":"2311.08788","title":"X-Eval: Generalizable Multi-aspect Text Evaluation via Augmented Instruction Tuning with Auxiliary Evaluation Aspects","created":"2023-11-15","cited_by_count":28},{"id":"2402.09764","title":"Aligning Crowd Feedback via Distributional Preference Reward Modeling","created":"2024-02-15","cited_by_count":28},{"id":"2412.00543","title":"Evaluating the Consistency of LLM Evaluators","created":"2024-11-30","cited_by_count":24},{"id":"2405.05894","title":"Efficient LLM Comparative Assessment: a Product of Experts Framework for Pairwise Comparisons","created":"2024-05-09","cited_by_count":22},{"id":"2410.07069","title":"ReIFE: Re-evaluating Instruction-Following Evaluation","created":"2024-10-09","cited_by_count":22},{"id":"2410.16027","title":"ComPO: Community Preferences for Language Model Personalization","created":"2024-10-21","cited_by_count":19},{"id":"2407.00087","title":"ARES: Alternating Reinforcement Learning and Supervised Fine-Tuning for Enhanced Multi-Modal Chain-of-Thought Reasoning Through Diverse AI Feedback","created":"2024-06-25","cited_by_count":13},{"id":"2410.12869","title":"Towards Acyclic Preference Evaluation of Language Models via Multiple Evaluators","created":"2024-10-14","cited_by_count":13},{"id":"2412.03605","title":"CBEval: A framework for evaluating and interpreting cognitive biases in LLMs","created":"2024-12-04","cited_by_count":12},{"id":"2411.12843","title":"Reward Modeling with Ordinal Feedback: Wisdom of the Crowd","created":"2024-11-19","cited_by_count":11},{"id":"2412.03822","title":"Beyond the Binary: Capturing Diverse Preferences With Reward Regularization","created":"2024-12-05","cited_by_count":11},{"id":"2410.22269","title":"Fourier Head: Helping Large Language Models Learn Complex Probability Distributions","created":"2024-10-29","cited_by_count":10},{"id":"2306.05808","title":"RankFormer: Listwise Learning-to-Rank Using Listwide Labels","created":"2023-06-09","cited_by_count":9},{"id":"2408.03359","title":"LAMPO: Large Language Models as Preference Machines for Few-shot Ordinal Classification","created":"2024-08-06","cited_by_count":5},{"id":"2406.08842","title":"ContraSolver: Self-Alignment of Language Models by Resolving Internal Preference Contradictions","created":"2024-06-13","cited_by_count":4},{"id":"2406.10267","title":"Unused information in token probability distribution of generative LLM: improving LLM reading comprehension through calculation of expected values","created":"2024-06-11","cited_by_count":4},{"id":"2412.04305","title":"ALMA: Alignment with Minimal Annotation","created":"2024-12-05","cited_by_count":3}],"next_cursor":null}