mlsanityData to 14 Oct 2026

ASTROCO: Self-Supervised Conformer-Style Transformers for Light-Curve Embeddings

arXiv 2509.24134 ↗First posted 29 Sep 2025astro-ph.IM cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present AstroCo, a Conformer-style encoder for irregular stellar light curves. By combining attention with depthwise convolutions and gating, AstroCo captures both global dependencies and local features. On MACHO R-band, AstroCo outperforms Astromer v1 and v2, yielding 70 percent and 61 percent lower error respectively and a relative macro-F1 gain of about 7 percent, while producing embeddings that transfer effectively to few-shot classification. These results highlight AstroCo's potential as a strong and label-efficient foundation for time-domain astronomy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 7 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

6 of 7 references.

References · 6

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  5. 2016Language Modeling with Gated Convolutional Networkscited by 702
  6. 2022ASTROMER: A transformer-based embedding for the representation of light curvescited by 9

Built on by

Not cited yet.