mlsanityData to 7 Oct 2026

ALiiCE: Evaluating Positional Fine-grained Citation Generation

arXiv 2406.13375 ↗First posted 19 Jun 2024cs.CLcited by 15

Not on the map. Why?

Abstract (arXiv)

Large Language Model (LLM) can enhance its credibility and verifiability by generating text with citations. However, existing research on citation generation is predominantly limited to sentence-level statements, neglecting the significance of positional fine-grained citations that can appear anywhere within sentences. To facilitate further exploration of the positional fine-grained citation generation, we propose ALiiCE, the first automatic evaluation framework for this task. Our method employs a dependency tree based approach to parse the sentence-level claim into atomic claims. Then ALiiCE evaluates citation quality using three metrics, including positional fine-grained citation recall, precision, and coefficient of variation of citation positions. We evaluate the positional fine-grained citation generation performance of several LLMs on long-form QA datasets. Our experiments and analyses demonstrate the effectiveness and reasonableness of ALiiCE. We offer our insights into the current advancements and future directions for the positional fine-grained citation generation task.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 28 of its 41 references that are in the map. First posted on arXiv 19 Jun 2024.

Builds on

28 of 41 references.

References · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  6. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  7. 2022A Survey on In-context Learningcited by 717
  8. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  9. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  10. 2019ELI5: Long Form Question Answeringcited by 567
  11. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  12. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
16 more
  1. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  2. 2023Evaluating Verifiability in Generative Search Enginescited by 297
  3. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  4. 2021Hurdles to Progress in Long-form Question Answeringcited by 166
  5. 2023Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Taskscited by 73
  6. 2023A Survey of Large Language Models Attributioncited by 71
  7. 2024Attribute First, then Generate: Locally-attributable Grounded Text Generationcited by 54
  8. 2023Understanding Retrieval Augmentation for Long-Form Question Answeringcited by 45
  9. 2023Effective Large Language Model Adaptation for Improved Grounding and Citation Generationcited by 44
  10. 2023"According to ...": Prompting Language Models Improves Quoting from Pre-Training Datacited by 42
  11. 2024Training Language Models to Generate Text with Citations via Fine-grained Rewardscited by 40
  12. 2022ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Datacited by 34
  13. 2023Retrieving Supporting Evidence for Generative Question Answeringcited by 31
  14. 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
  15. 2022CORWA: A Citation-Oriented Related Work Annotation Datasetcited by 17
  16. 2024Related Work and Citation Text Generation: A Surveycited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 5.

15 papers.

Sort:

By area: