mlsanityData to 7 Oct 2026

Assisting humans in complex comparisons: automated information comparison at scale

arXiv 2404.04351 ↗First posted 5 Apr 2024cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative Large Language Models enable efficient analytics across knowledge domains, rivalling human experts in information comparisons. However, the applications of LLMs for information comparisons face scalability challenges due to the difficulties in maintaining information across large contexts and overcoming model token limitations. To address these challenges, we developed the novel Abstractive Summarization & Criteria-driven Comparison Endpoint (ASC2End) system to automate information comparison at scale. Our system employs Semantic Text Similarity comparisons for generating evidence-supported analyses. We utilize proven data-handling strategies such as abstractive summarization and retrieval augmented generation to overcome token limitations and retain relevant information during model inference. Prompts were designed using zero-shot strategies to contextualize information for improved model reasoning. We evaluated abstractive summarization using ROUGE scoring and assessed the generated comparison quality using survey responses. Models evaluated on the ASC2End system show desirable results providing insights on the expected performance of the system. ASC2End is a novel system and tool that enables accurate, automated information comparison at scale across knowledge domains, overcoming limitations in context length and retrieval.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 5 Apr 2024.

Builds on

32 of 47 references.

References · 32

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  5. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  6. 2017Billion-scale similarity search with GPUscited by 2,477
  7. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  8. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,838
  9. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  10. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
  11. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  12. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
20 more
  1. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  2. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  3. 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 211
  4. 2023Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4cited by 202
  5. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  6. 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
  7. 2023Reasoning Implicit Sentiment with Chain-of-Thought Promptingcited by 79
  8. 2023GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Promptscited by 34
  9. 2023Automated Paper Screening for Clinical Reviews Using Large Language Modelscited by 29
  10. 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
  11. 2023Pushing the Limits of ChatGPT on NLP Taskscited by 27
  12. 2023Bring Your Own Data! Self-Supervised Evaluation for Large Language Modelscited by 17
  13. 2022End-to-End Table Question Answering via Retrieval-Augmented Generationcited by 12
  14. 2023Text Encoders Lack Knowledge: Leveraging Generative LLMs for Domain-Specific Semantic Textual Similaritycited by 11
  15. 2023Forcing Generative Models to Degenerate Ones: The Power of Data Poisoning Attackscited by 9
  16. 2023Improving Factuality of Abstractive Summarization without Sacrificing Summary Qualitycited by 7
  17. 2023Abstractive Summarization of Large Document Collections Using GPTcited by 6
  18. 2023Breaking the Token Barrier: Chunking and Convolution for Efficient Long Text Classification with BERTcited by 6
  19. 2013Description and Evaluation of Semantic Similarity Measures Approachescited by 4
  20. 2023The economic trade-offs of large language models: A case studycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Leveraging Large Language Models for Comparative Literature Summarization with Reflective Incremental Mechanisms
  2. 2023Large Language Models are Not Yet Human-Level Evaluators for Abstractive Summarization
  3. 2025Beyond Perplexity: Let the Reader Select Retrieval Summaries via Spectrum Projection Score
  4. 2025IDEAlign: Comparing Ideas of Large Language Models to Domain Expert
  5. 2026Beyond Accuracy: A Multidimensional Evaluation of Statistical Reasoning in Large Language Models
  6. 2024Language agents achieve superhuman synthesis of scientific knowledge
  7. 2024DCR-Consistency: Divide-Conquer-Reasoning for Consistency Evaluation and Improvement of Large Language Models
  8. 2024How Much Annotation is Needed to Compare Summarization Models?