# Seq2Biseq: Bidirectional Output-wise Recurrent Neural Networks for Sequence Modelling

arXiv: https://arxiv.org/abs/1904.04733 · HTML: https://mlsanity.com/paper/1904.04733/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 9 Apr 2019.

## Built on by (most cited first, 4 of 4)

- [Probabilistic Transformer: A Probabilistic Dependency Model for Contextual Word Representation](https://mlsanity.com/paper/2311.15211/) (2023)
- [GPTQT: Quantize Large Language Models Twice to Push the Efficiency](https://mlsanity.com/paper/2407.02891/) (2024)
- [Ternary Singular Value Decomposition as a Better Parameterized Form in Linear Mapping](https://mlsanity.com/paper/2308.07641/) (2023)
- [Semantics-Preserved Distortion for Personal Privacy Protection in Information Management](https://mlsanity.com/paper/2201.00965/) (2022)

## Abstract (arXiv)

During the last couple of years, Recurrent Neural Networks (RNN) have reached state-of-the-art performances on most of the sequence modelling problems. In particular, the "sequence to sequence" model and the neural CRF have proved to be very effective in this domain. In this article, we propose a new RNN architecture for sequence labelling, leveraging gated recurrent layers to take arbitrarily long contexts into account, and using two decoders operating forward and backward. We compare several variants of the proposed solution and their performances to the state-of-the-art. Most of our results are better than the state-of-the-art or very close to it and thanks to the use of recent technologies, our architecture can scale on corpora larger than those used in this work.