mlsanityData to 14 Oct 2026

Evaluating LLMs on Chinese Topic Constructions: A Research Proposal Inspired by Tian et al. (2024)

arXiv 2504.14969 ↗First posted 21 Apr 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper proposes a framework for evaluating large language models (LLMs) on Chinese topic constructions, focusing on their sensitivity to island constraints. Drawing inspiration from Tian et al. (2024), we outline an experimental design for testing LLMs' grammatical knowledge of Mandarin syntax. While no experiments have been conducted yet, this proposal aims to provide a foundation for future studies and invites feedback on the methodology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 18 references that are in the map. First posted on arXiv 21 Apr 2025.

Builds on

6 of 18 references.

References · 6

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2018Neural Network Acceptability Judgmentscited by 958
  4. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
  5. 2018What do RNN Language Models Learn about Filler-Gap Dependencies?cited by 86
  6. 2024How to Make the Most of LLMs' Grammatical Knowledge for Acceptability Judgmentscited by 14

Built on by

Not cited yet.