ASTROCO: Self-Supervised Conformer-Style Transformers for Light-Curve Embeddings
Not on the map. Why?
Abstract (arXiv)
We present AstroCo, a Conformer-style encoder for irregular stellar light curves. By combining attention with depthwise convolutions and gating, AstroCo captures both global dependencies and local features. On MACHO R-band, AstroCo outperforms Astromer v1 and v2, yielding 70 percent and 61 percent lower error respectively and a relative macro-F1 gain of about 7 percent, while producing embeddings that transfer effectively to few-shot classification. These results highlight AstroCo's potential as a strong and label-efficient foundation for time-domain astronomy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 7 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
6 of 7 references.
References · 6
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2016Language Modeling with Gated Convolutional Networkscited by 702
- 2022ASTROMER: A transformer-based embedding for the representation of light curvescited by 9
Built on by
Not cited yet.