mlsanityData to 14 Oct 2026

Span-level Detection of AI-generated Scientific Text via Contrastive Learning and Structural Calibration

arXiv 2510.00890 ↗First posted 1 Oct 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The rapid adoption of large language models (LLMs) in scientific writing raises serious concerns regarding authorship integrity and the reliability of scholarly publications. Existing detection approaches mainly rely on document-level classification or surface-level statistical cues; however, they neglect fine-grained span localization, exhibit weak calibration, and often fail to generalize across disciplines and generators. To address these limitations, we present Sci-SpanDet, a structure-aware framework for detecting AI-generated scholarly texts. The proposed method combines section-conditioned stylistic modeling with multi-level contrastive learning to capture nuanced human-AI differences while mitigating topic dependence, thereby enhancing cross-domain robustness. In addition, it integrates BIO-CRF sequence labeling with pointer-based boundary decoding and confidence calibration to enable precise span-level detection and reliable probability estimates. Extensive experiments on a newly constructed cross-disciplinary dataset of 100,000 annotated samples generated by multiple LLM families (GPT, Qwen, DeepSeek, LLaMA) demonstrate that Sci-SpanDet achieves state-of-the-art performance, with F1(AI) of 80.17, AUROC of 92.63, and Span-F1 of 74.36. Furthermore, it shows strong resilience under adversarial rewriting and maintains balanced accuracy across IMRaD sections and diverse disciplines, substantially surpassing existing baselines. To ensure reproducibility and to foster further research on AI-generated text detection in scholarly documents, the curated dataset and source code will be publicly released upon publication.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 48 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

26 of 48 references.

References · 26

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2020Longformer: The Long-Document Transformercited by 3,413
  3. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  4. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  5. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  8. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
  9. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  10. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  11. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  12. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
14 more
  1. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
  2. 2021A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generationcited by 138
  3. 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
  4. 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 105
  5. 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
  6. 2022Revisiting Transformer-based Models for Long Document Classificationcited by 49
  7. 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
  8. 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
  9. 2023CHEAT: A Large-scale Dataset for Detecting ChatGPT-writtEn AbsTractscited by 40
  10. 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
  11. 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
  12. 2024Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answeringcited by 20
  13. 2022A Benchmark Corpus for the Detection of Automatically Generated Text in Academic Publicationscited by 18
  14. 2024Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Textcited by 16

Built on by

Not cited yet.