mlsanityData to 7 Oct 2026

Can Decision Models Understand Stance? Evaluating Jev Against General-Purpose LLMs

arXiv 2610.11901 ↗First posted 8 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Stance detection requires identifying an author's attitude toward a given target, sometimes based on conversational context. Jev, a specialized decision model designed for structured decision-making, offers an alternative to general-purpose large language models (LLMs). In this work, we evaluate Jev on two stance detection datasets, VAST (English texts) and ZS-CSD (Chinese conversations), comparing it with four general-purpose LLMs and two fine-tuned models. Results show that Jev achieves competitive performance on VAST, matching GPT-5.6 and outperforming the other general-purpose LLMs. However, it falls behind stronger LLMs on ZS-CSD, particularly in distinguishing favor from against. Further analysis suggests that this limitation may be related to understanding reply relationships and stance direction rather than conversation length alone. These findings highlight both the potential and limitations of Jev for stance detection.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 25 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

7 of 25 references.

References · 7

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2024Qwen2.5 Technical Reportcited by 4,713
  3. 2020Stance in Replies and Quotes (SRQ): A New Dataset For Learning Stance in Twitter Conversationscited by 14
  4. 2026Jev for Scientific Decisions: Evaluating Semantic Choices and Their Consequencescited by 10
  5. 2026Can Jev Judge Radiology Reports? Evaluating a System One Model for Clinical Factualitycited by 8
  6. 2026Same Scores, Different Decisions: Evaluating JEV and Language Models for Legal Document Understandingcited by 8
  7. 2026JEV vs. LLMs as Rubric Judges: Cheaper, Faster, and Wrong in the Same Placescited by 5

Built on by

Not cited yet.