# Punctuation-aware treebank tree binarization

arXiv: https://arxiv.org/abs/2510.10951 · HTML: https://mlsanity.com/paper/2510.10951/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 1 of its 10 references that are in the map.
- First posted on arXiv 13 Oct 2025.

## Builds on (most cited first, 1 of 1)

- [In-Order Transition-based Constituent Parsing](https://mlsanity.com/paper/1707.05000/) (2017)

## Abstract (arXiv)

This article presents a curated resource and evaluation suite for punctuation-aware treebank binarization. Standard binarization pipelines drop punctuation before head selection, which alters constituent shape and harms head-child identification. We release (1) a reproducible pipeline that preserves punctuation as sibling nodes prior to binarization, (2) derived artifacts and metadata (intermediate @X markers, reversibility signatures, alignment indices), and (3) an accompanying evaluation suite covering head-child prediction, round-trip reversibility, and structural compatibility with derivational resources (CCGbank). On the Penn Treebank, punctuation-aware preprocessing improves head prediction accuracy from 73.66% (Collins rules) and 86.66% (MLP) to 91.85% with the same classifier, and achieves competitive alignment against CCGbank derivations. All code, configuration files, and documentation are released to enable replication and extension to other corpora.