# NLP Research and Resources at DaSciM, Ecole Polytechnique

arXiv: https://arxiv.org/abs/2112.00566 · HTML: https://mlsanity.com/paper/2112.00566/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 15 of its 26 references that are in the map.
- First posted on arXiv 1 Dec 2021.

## Builds on (most cited first, 15 of 15)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension](https://mlsanity.com/paper/1910.13461/) (2019)
- [Unsupervised Abstractive Meeting Summarization with Multi-Sentence Compression and Budgeted Submodular Maximization](https://mlsanity.com/paper/1805.05271/) (2018)
- [BARThez: a Skilled Pretrained French Sequence-to-Sequence Model](https://mlsanity.com/paper/2010.12321/) (2020)
- [Message Passing Attention Networks for Document Understanding](https://mlsanity.com/paper/1908.06267/) (2019)
- [JuriBERT: A Masked-Language Model Adaptation for French Legal Text](https://mlsanity.com/paper/2110.01485/) (2021)
- [BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets](https://mlsanity.com/paper/2109.10234/) (2021)
- [Word Embeddings from Large-Scale Greek Web Content](https://mlsanity.com/paper/1810.06694/) (2018)
- [Speaker-change Aware CRF for Dialogue Act Classification](https://mlsanity.com/paper/2004.02913/) (2020)
- [Performance in the Courtroom: Automated Processing and Visualization of Appeal Court Decisions in France](https://mlsanity.com/paper/2006.06251/) (2020)
- [Unsupervised Word Polysemy Quantification with Multiresolution Grids of Contextual Embeddings](https://mlsanity.com/paper/2003.10224/) (2020)
- [Energy-based Self-attentive Learning of Abstractive Communities for Spoken Language Understanding](https://mlsanity.com/paper/1904.09491/) (2019)
- [Evaluation of Greek Word Embeddings](https://mlsanity.com/paper/1904.04032/) (2019)
- [Evaluation Of Word Embeddings From Large-Scale French Web Content](https://mlsanity.com/paper/2105.01990/) (2021)

## Abstract (arXiv)

DaSciM (Data Science and Mining) part of LIX at Ecole Polytechnique, established in 2013 and since then producing research results in the area of large scale data analysis via methods of machine and deep learning. The group has been specifically active in the area of NLP and text mining with interesting results at methodological and resources level. Here follow our different contributions of interest to the AFIA community.