{"list":"other","total":56,"rows":[{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"1904.09675","title":"BERTScore: Evaluating Text Generation with BERT","created":"2019-04-21","cited_by_count":5512},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2303.16634","title":"G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment","created":"2023-03-29","cited_by_count":2276},{"id":"2112.00861","title":"A General Language Assistant as a Laboratory for Alignment","created":"2021-12-01","cited_by_count":1055},{"id":"2411.15124","title":"Tulu 3: Pushing Frontiers in Open Language Model Post-Training","created":"2024-11-22","cited_by_count":1053},{"id":"2005.04118","title":"Beyond Accuracy: Behavioral Testing of NLP models with CheckList","created":"2020-05-08","cited_by_count":1006},{"id":"2404.04475","title":"Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators","created":"2024-04-06","cited_by_count":897},{"id":"2305.14387","title":"AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback","created":"2023-05-22","cited_by_count":748},{"id":"2305.01937","title":"Can Large Language Models Be an Alternative to Human Evaluations?","created":"2023-05-03","cited_by_count":734},{"id":"2106.11520","title":"BARTScore: Evaluating Generated Text as Text Generation","created":"2021-06-22","cited_by_count":722},{"id":"2310.08491","title":"Prometheus: Inducing Fine-grained Evaluation Capability in Language Models","created":"2023-10-12","cited_by_count":575},{"id":"2411.16594","title":"From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge","created":"2024-11-25","cited_by_count":494},{"id":"2408.15240","title":"Generative Verifiers: Reward Modeling as Next-Token Prediction","created":"2024-08-27","cited_by_count":480},{"id":"2303.04048","title":"Is ChatGPT a Good NLG Evaluator? A Preliminary Study","created":"2023-03-07","cited_by_count":422},{"id":"2302.14520","title":"Large Language Models Are State-of-the-Art Evaluators of Translation Quality","created":"2023-02-28","cited_by_count":420},{"id":"2306.01693","title":"Fine-Grained Human Feedback Gives Better Rewards for Language Model Training","created":"2023-06-02","cited_by_count":401},{"id":"2207.10397","title":"CodeT: Code Generation with Generated Tests","created":"2022-07-21","cited_by_count":384},{"id":"1603.08023","title":"How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation","created":"2016-03-25","cited_by_count":356},{"id":"2402.10669","title":"Humans or LLMs as the Judge? A Study on Judgement Biases","created":"2024-02-16","cited_by_count":323},{"id":"2310.03716","title":"A Long Way to Go: Investigating Length Correlations in RLHF","created":"2023-10-05","cited_by_count":291},{"id":"2107.00061","title":"All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text","created":"2021-06-30","cited_by_count":287},{"id":"2311.09476","title":"ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems","created":"2023-11-16","cited_by_count":265},{"id":"2210.07197","title":"Towards a Unified Multi-Dimensional Evaluator for Text Generation","created":"2022-10-13","cited_by_count":264},{"id":"2404.10774","title":"MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents","created":"2024-04-16","cited_by_count":257},{"id":"2406.04770","title":"WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild","created":"2024-06-07","cited_by_count":218},{"id":"2307.10928","title":"FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets","created":"2023-07-20","cited_by_count":201},{"id":"2005.00456","title":"USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation","created":"2020-05-01","cited_by_count":188},{"id":"2405.01724","title":"Large Language Models are Inconsistent and Biased Evaluators","created":"2024-05-02","cited_by_count":153},{"id":"2404.12272","title":"Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences","created":"2024-04-18","cited_by_count":144},{"id":"2112.01640","title":"MultiVerS: Improving scientific claim verification with weak supervision and full-document context","created":"2021-12-02","cited_by_count":143},{"id":"2006.12719","title":"Unsupervised Evaluation of Interactive Dialog with DialoGPT","created":"2020-06-23","cited_by_count":139},{"id":"1905.04071","title":"Survey on Evaluation Methods for Dialogue Systems","created":"2019-05-10","cited_by_count":126},{"id":"2305.18201","title":"A Critical Evaluation of Evaluations for Long-form Question Answering","created":"2023-05-29","cited_by_count":111},{"id":"2310.15123","title":"Branch-Solve-Merge Improves Large Language Model Evaluation and Generation","created":"2023-10-23","cited_by_count":106},{"id":"1708.07149","title":"Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses","created":"2017-08-23","cited_by_count":98},{"id":"2109.06835","title":"The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation","created":"2021-09-14","cited_by_count":97},{"id":"2301.13298","title":"LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization","created":"2023-01-30","cited_by_count":96},{"id":"2403.18771","title":"CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists","created":"2024-03-27","cited_by_count":94},{"id":"2404.08555","title":"RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs","created":"2024-04-12","cited_by_count":90},{"id":"2309.16349","title":"Human Feedback is not Gold Standard","created":"2023-09-28","cited_by_count":83},{"id":"2305.04207","title":"No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation","created":"2023-05-07","cited_by_count":82},{"id":"2305.13735","title":"Aligning Large Language Models through Synthetic Feedback","created":"2023-05-23","cited_by_count":75},{"id":"1803.05928","title":"RankME: Reliable Human Ratings for Natural Language Generation","created":"2018-03-15","cited_by_count":69},{"id":"2201.04723","title":"Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents","created":"2022-01-12","cited_by_count":62},{"id":"2409.15254","title":"Archon: An Architecture Search Framework for Inference-Time Techniques","created":"2024-09-23","cited_by_count":60},{"id":"2407.08488","title":"Lynx: An Open Source Hallucination Evaluation Model","created":"2024-07-11","cited_by_count":57},{"id":"2408.06266","title":"Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment","created":"2024-08-12","cited_by_count":46},{"id":"2312.15407","title":"A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators","created":"2023-12-24","cited_by_count":45},{"id":"2311.00168","title":"The Alignment Ceiling: Objective Mismatch in Reinforcement Learning from Human Feedback","created":"2023-10-31","cited_by_count":42},{"id":"2407.03479","title":"Human-Centered Design Recommendations for LLM-as-a-Judge","created":"2024-07-03","cited_by_count":37},{"id":"2402.15754","title":"HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition","created":"2024-02-24","cited_by_count":33},{"id":"2111.05241","title":"A Survey of NLP-Related Crowdsourcing HITs: what works and what does not","created":"2021-11-09","cited_by_count":15}],"next_cursor":null}