mlsanityData to 7 Oct 2026

URECA: The Chain of Two Minimum Set Cover Problems exists behind Adaptation to Shifts in Semantic Code Search

arXiv 2502.07494 ↗First posted 11 Feb 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Adaptation is to make model learn the patterns shifted from the training distribution. In general, this adaptation is formulated as the minimum entropy problem. However, the minimum entropy problem has inherent limitation -- shifted initialization cascade phenomenon. We extend the relationship between the minimum entropy problem and the minimum set cover problem via Lebesgue integral. This extension reveals that internal mechanism of the minimum entropy problem ignores the relationship between disentangled representations, which leads to shifted initialization cascade. From the analysis, we introduce a new clustering algorithm, Union-find based Recursive Clustering Algorithm~(URECA). URECA is an efficient clustering algorithm for the leverage of the relationships between disentangled representations. The update rule of URECA depends on Thresholdly-Updatable Stationary Assumption to dynamics as a released version of Stationary Assumption. This assumption helps URECA to transport disentangled representations with no errors based on the relationships between disentangled representations. URECA also utilize simulation trick to efficiently cluster disentangled representations. The wide range of evaluations show that URECA achieves consistent performance gains for the few-shot adaptation to diverse types of shifts along with advancement to State-of-The-Art performance in CoSQA in the scenario of query shift.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 11 Feb 2025.

Builds on

29 of 44 references.

References · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  5. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  6. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  7. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
  8. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 638
  9. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  10. 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 355
  11. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  12. 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
17 more
  1. 2021A Fine-Grained Analysis on Distribution Shiftcited by 171
  2. 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
  3. 2022DocPrompting: Generating Code by Retrieving the Docscited by 151
  4. 2017Unsupervised Learning of Disentangled Representations from Videocited by 138
  5. 2022Disentangled Representation Learningcited by 111
  6. 2024Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factorscited by 106
  7. 2018Lipschitz Continuity in Model-based Reinforcement Learningcited by 90
  8. 2021CoSQA: 20,000+ Web Queries for Code Search and Question Answeringcited by 74
  9. 2019When Deep Learning Met Code Searchcited by 45
  10. 2024In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigationcited by 43
  11. 2024The Entropy Enigma: Success and Failure of Entropy Minimizationcited by 24
  12. 2022CoCoSoDa: Effective Contrastive Learning for Code Searchcited by 21
  13. 2024Rewriting the Code: A Simple Method for Large Language Model Augmented Code Searchcited by 17
  14. 2017DNA-GAN: Learning Disentangled Representations from Multi-Attribute Imagescited by 16
  15. 2019InfoGAN-CR and ModelCentrality: Self-supervised Model Training and Selection for Disentangling GANscited by 16
  16. 2023Exploring Distributional Shifts in Large Language Models for Code Analysiscited by 14
  17. 2023Rethinking Negative Pairs in Code Searchcited by 14

Built on by

Not cited yet.