TAROT: A Hierarchical Framework with Multitask Co-Pretraining on Semi-Structured Data towards Effective Person-Job Fit
Not on the map. Why?
Abstract (arXiv)
Person-job fit is an essential part of online recruitment platforms in serving various downstream applications like Job Search and Candidate Recommendation. Recently, pretrained large language models have further enhanced the effectiveness by leveraging richer textual information in user profiles and job descriptions apart from user behavior features and job metadata. However, the general domain-oriented design struggles to capture the unique structural information within user profiles and job descriptions, leading to a loss of latent semantic correlations. We propose TAROT, a hierarchical multitask co-pretraining framework, to better utilize structural and semantic information for informative text embeddings. TAROT targets semi-structured text in profiles and jobs, and it is co-pretained with multi-grained pretraining tasks to constrain the acquired semantic information at each level. Experiments on a real-world LinkedIn dataset show significant performance improvements, proving its effectiveness in person-job fit tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 15 Jan 2024.
Builds on
15 of 22 references.
References · 15
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processingcited by 161
- 2021TrafficStream: A Streaming Traffic Flow Forecasting Framework Based on Graph Neural Networks and Continual Learningcited by 42
- 2018Enhancing Person-Job Fit for Talent Recruitment: An Ability-aware Neural Network Approachcited by 37
- 2021TabularNet: A Neural Network Architecture for Understanding Semantic Structures of Tabular Datacited by 36
- 2020Learning to Match Jobs with Resumes from Sparse Interaction Data using Multi-View Co-Teaching Networkcited by 23
- 2020On the importance of pre-training data volume for compact language modelscited by 21
- 2023Text-to-Image Generation for Abstract Conceptscited by 18
- 2020TSSRGCN: Temporal Spectral Spatial Retrieval Graph Convolutional Network for Traffic Flow Forecastingcited by 14
Built on by
Citing papers per year: 2025: 1.
1 paper.