# Enhancing low energy reconstruction and classification in KM3NeT/ORCA with transformers

arXiv: https://arxiv.org/abs/2511.18999 · HTML: https://mlsanity.com/paper/2511.18999/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 2 of its 9 references that are in the map.
- First posted on arXiv 24 Nov 2025.

## Builds on (most cited first, 2 of 2)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Particle Transformer for Jet Tagging](https://mlsanity.com/paper/2202.03772/) (2022)

## Abstract (arXiv)

The current KM3NeT/ORCA neutrino telescope, still under construction, has not yet reached its full potential in neutrino reconstruction capability. When training any deep learning model, no explicit information about the physics or the detector is provided, thus they remain unknown to the model. This study leverages the strengths of transformers by incorporating attention masks inspired by the physics and detector design, making the model understand both the telescope design and the neutrino physics measured on it. The study also shows the efficacy of transformers on retaining valuable information between detectors when doing fine-tuning from one configurations to another.