mlsanityData to 14 Oct 2026

ACAT: A Collaborative Platform for Efficient Aspect-Based Sentiment Dataset Annotation

arXiv 2606.04189 ↗First posted 2 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Aspect-Based Sentiment Analysis (ABSA) requires high-quality datasets to train reliable models. However, existing annotation tools treat output as flat files, leaving researchers to manually consolidate multi-annotator data, reconstruct relational structures, and compute reliability metrics through custom scripts. This paper introduces ACAT (Aspect-based sentiment analysis Collaborative Annotation Tool), a web-based platform natively supporting four ABSA workflows: (1) Aspect-Category Sentiment Analysis, (2) Clause-Level Segmentation, (3) Aspect-Term Sentiment Analysis with character-level position tracking, and (4) Aspect Sentiment Triplet Extraction with dual span offset preservation. Its core contribution is an automated Extract, Transform, Load (ETL) pipeline that aligns collaborative annotations and computes Inter-Annotator Agreement (IAA) metrics directly at export, yielding training-ready datasets. In a preliminary validation on 1,002 restaurant reviews with two annotators of differing expertise, ACAT achieves a median annotation time of 31.58 seconds and a raw IAA ranging from 0.78 to 0.86 across all tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 19 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

9 of 19 references.

References · 9

  1. 2021Implicit Representations of Meaning in Neural Language Modelscited by 180
  2. 2019Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysiscited by 123
  3. 2016SentiHood: Targeted Aspect Based Sentiment Analysis Dataset for Urban Neighbourhoodscited by 32
  4. 2021LightTag: Text Annotation Platformcited by 16
  5. 2017YEDDA: A Lightweight Collaborative Text Span Annotation Toolcited by 13
  6. 2025Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaningcited by 10
  7. 2023EDSA-Ensemble: an Event Detection Sentiment Analysis Ensemble Architecturecited by 8
  8. 2025EduRABSA: An Education Review Dataset for Aspect-based Sentiment Analysis Taskscited by 5
  9. 2023ATESA-BAERT: A Heterogeneous Ensemble Learning Model for Aspect-Based Sentiment Analysiscited by 2

Built on by

Not cited yet.