EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classification
Not on the map. Why?
Abstract (arXiv)
The timing of cell divisions in early embryos during the In-Vitro Fertilization (IVF) process is a key predictor of embryo viability. However, observing cell divisions in Time-Lapse Monitoring (TLM) is a time-consuming process and highly depends on experts. In this paper, we propose EmbryosFormer, a computational model to automatically detect and classify cell divisions from original time-lapse images. Our proposed network is designed as an encoder-decoder deformable transformer with collaborative heads. The transformer contracting path predicts per-image labels and is optimized by a classification head. The transformer expanding path models the temporal coherency between embryo images to ensure monotonic non-decreasing constraint and is optimized by a segmentation head. Both contracting and expanding paths are synergetically learned by a collaboration head. We have benchmarked our proposed EmbryosFormer on two datasets: a public dataset with mouse embryos with 8-cell stage and an in-house dataset with human embryos with 4-cell stage. Source code: https://github.com/UARK-AICV/Embryos.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 31 of its 50 references that are in the map. First posted on arXiv 7 Oct 2022.
Builds on
31 of 50 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2014Going Deeper with Convolutionscited by 4,231
19 more
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2020Pre-Trained Image Processing Transformercited by 891
- 2017Deep Learning for Medical Image Analysiscited by 399
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
- 2021End-to-End Dense Video Captioning with Parallel Decodingcited by 133
- 2021Contextual Transformer Networks for Visual Recognitioncited by 90
- 2021Differentiable Patch Selection for Image Recognitioncited by 68
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2018Learning to recognize Abnormalities in Chest X-Rays with Location-Aware Dense Networkscited by 33
- 2020Offset Curves Loss for Imbalanced Problem in Medical Segmentationcited by 11
- 2021AEI: Actors-Environment Interaction with Adaptive Attention for Temporal Action Proposals Generationcited by 11
- 2022Point-Unet: A Context-aware Point-based Neural Network for Volumetric Segmentationcited by 11
- 2022SS-3DCapsNet: Self-supervised 3D Capsule Networks for Medical Segmentation on Less Labeled Datacited by 10
- 2020A Multi-task Contextual Atrous Residual Network for Brain Tumor Detection & Segmentationcited by 9
- 2020Automated Measurements of Key Morphological Features of Human Embryos for IVFcited by 8
- 20223D-UCaps: 3D Capsules Unet for Volumetric Image Segmentationcited by 7
- 2021Developmental Stage Classification of Embryos Using Two-Stream Neural Network with Linear-Chain Conditional Random Fieldcited by 6
- 2021DAM-AL: Dilated Attention Mechanism with Attention Loss for 3D Infant Brain Image Segmentationcited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 5; 2026: 1.
12 papers.
- 2023ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detectioncited by 12
- 2024FG-CXR: A Radiologist-Aligned Gaze Dataset for Enhancing Interpretability in Chest X-Ray Report Generationcited by 4
- 2025Early prediction of the transferability of bovine embryos from videomicroscopycited by 2
- 2023SolarFormer: Multi-scale Transformer for Solar PV Profilingcited by 1
- 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defectcited by 1
- 2023Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Typescited by 0
- 2024S3Former: Self-supervised High-resolution Transformer for Solar PV Profilingcited by 0
- 2025Supervised contrastive learning for cell stage classification of animal embryoscited by 0
- 2025Multi-Modal Artificial Intelligence of Embryo Grading and Pregnancy Prediction in Assisted Reproductive Technology: A Reviewcited by 0
- 2025Time-Lapse Video-Based Embryo Grading via Complementary Spatial-Temporal Pattern Miningcited by 0
- 2025Cytoplasmic Strings Analysis in Human Embryo Time-Lapse Videos using Deep Learning Frameworkcited by 0
- 2026From Division to Decision: Leveraging Temporal Cell-Stage Segmentation for Embryo Transferability Predictioncited by 0
- 2026From Division to Decision: Leveraging Temporal Cell-Stage Segmentation for Embryo Transferability Prediction18 May 2026
- 2025Cytoplasmic Strings Analysis in Human Embryo Time-Lapse Videos using Deep Learning Framework10 Dec 2025
- 2025Time-Lapse Video-Based Embryo Grading via Complementary Spatial-Temporal Pattern Mining5 Jun 2025
- 2025Multi-Modal Artificial Intelligence of Embryo Grading and Pregnancy Prediction in Assisted Reproductive Technology: A Review19 May 2025
- 2025Supervised contrastive learning for cell stage classification of animal embryos11 Feb 2025
- 2025Early prediction of the transferability of bovine embryos from videomicroscopy14 Jan 2025
- 2024FG-CXR: A Radiologist-Aligned Gaze Dataset for Enhancing Interpretability in Chest X-Ray Report Generation23 Nov 2024
- 2024S3Former: Self-supervised High-resolution Transformer for Solar PV Profiling7 May 2024
- 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defect17 Apr 2024
- 2023Single-Cell Deep Clustering Method Assisted by Exogenous Gene Information: A Novel Approach to Identifying Cell Types28 Nov 2023
- 2023ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection1 Nov 2023
- 2023SolarFormer: Multi-scale Transformer for Solar PV Profiling30 Oct 2023