Beyond Paper-to-Paper: Structured Profiling and Rubric Scoring for Paper-Reviewer Matching
Not on the map. Why?
Abstract (arXiv)
As conference submission volumes continue to grow, accurately recommending suitable reviewers has become a challenge. Most existing methods follow a ``Paper-to-Paper'' matching paradigm, implicitly representing a reviewer by their publication history. However, effective reviewer matching requires capturing multi-dimensional expertise, and textual similarity to past papers alone is often insufficient. To address this gap, we propose P2R, a training-free framework that shifts from implicit paper-to-paper matching to explicit profile-based matching. P2R uses general-purpose LLMs to construct structured profiles for both submissions and reviewers, disentangling them into Topics, Methodologies, and Applications. Building on these profiles, P2R adopts a coarse-to-fine pipeline to balance efficiency and depth. It first performs hybrid retrieval that combines semantic and aspect-level signals to form a high-recall candidate pool, and then applies an LLM-based committee to evaluate candidates under strict rubrics, integrating both multi-dimensional expert views and a holistic Area Chair perspective. Experiments on NeurIPS, SIGIR, and SciRepEval show that P2R consistently outperforms state-of-the-art baselines. Ablation studies further verify the necessity of each component. Overall, P2R highlights the value of explicit, structured expertise modeling and offers practical guidance for applying LLMs to reviewer matching.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
24 of 39 references.
References · 24
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2024NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Modelscited by 472
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
- 2023Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agentscited by 360
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
- 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
- 2023A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challengecited by 55
- 2022COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learningcited by 20
- 2022Graph Soft-Contrastive Learning via Neighborhood Rankingcited by 16
12 more
- 2021LightCAKE: A Lightweight Framework for Context-Aware Knowledge Graph Embeddingcited by 11
- 2023Counterfactual Evaluation of Peer-Review Assignment Policiescited by 11
- 2023Resolving the Imbalance Issue in Hierarchical Disciplinary Topic Inference via LLM-based Data Augmentationcited by 11
- 2023Chain-of-Factors Paper-Reviewer Matchingcited by 11
- 2021RPT: Toward Transferable Model on Heterogeneous Researcher Data via Pre-Trainingcited by 9
- 2023Adaptive Path-Memory Network for Temporal Knowledge Graph Reasoningcited by 9
- 2024FedGCS: A Generative Framework for Efficient Client Selection in Federated Learning via Gradient-based Optimizationcited by 9
- 2023Interdisciplinary Fairness in Imbalanced Research Proposal Topic Inference: A Hierarchical Transformer-based Method with Selective Interpolationcited by 8
- 2025Deep Cut-informed Graph Embedding and Clusteringcited by 7
- 2020Context-Enhanced Entity and Relation Embedding for Knowledge Graph Completioncited by 6
- 2025Rethinking Graph Contrastive Learning through Relative Similarity Preservationcited by 5
- 2025FRONTIER-RevRec: A Large-scale Dataset for Reviewer Recommendationcited by 3
Built on by
Not cited yet.