mlsanityData to 7 Oct 2026

TELLER: Dual-Path Iterative Preference Optimization for Table Entity Linking

arXiv 2607.28680 ↗First posted 29 Jul 2026cs.CL cs.LGcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

Entity linking in tables matches short and ambiguous cell mentions to their corresponding knowledge-base entities. Existing approaches typically rely on data preprocessing pipelines that retain either compact or extensive table content as contextual evidence, and then formulate entity linking as a language generation task for instruction-tuned models; recent systems further incorporate explicit reasoning to disambiguate challenging mentions. However, their training supervision is usually static: fixed preference data cannot adapt to the residual errors of an evolving model, while variations in reasoning length can bias sequence-level preference learning. To address these limitations, we present TELLER: Table Entity Linking through Learning from Errors and Reasoning. We first retrieve and rank Wikidata candidates and retain reduced table evidence in the prompt. The direct-answer path applies iterative direct preference optimization and refreshes its preference data with residual errors from the updated model. The reasoning path uses filtered and compressed chain-of-thought rationales for supervised fine-tuning, followed by our iterative length-normalized regularized preference optimization. On the TableInstruct entity-linking subset, the direct-answer path improves accuracy from 94.35% to 94.50%; on the MammoTab V2 evaluation set, it improves accuracy from 87.59% to 88.20%. The reasoning path improves accuracy from 92.90% to 92.95% on TableInstruct and from 79.09% to 81.85% on MammoTab V2, while maintaining high rates of complete reasoning generation. These results show that iterative preference learning benefits both concise entity prediction and explicit reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 42 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

29 of 42 references.

References · 29

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
  6. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
  7. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 895
  8. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  9. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 710
  10. 2023Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraintcited by 346
  11. 2020Autoregressive Entity Retrievalcited by 333
  12. 2022Large Language Models Are Reasoning Teacherscited by 318
17 more
  1. 2022Teaching Small Language Models to Reasoncited by 279
  2. 2025TokenSkip: Controllable Chain-of-Thought Compression in LLMscited by 246
  3. 2024Iterative Reasoning Preference Optimizationcited by 244
  4. 2024Disentangling Length from Quality in Direct Preference Optimizationcited by 194
  5. 2023Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Stepcited by 144
  6. 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 136
  7. 2021Reframing Human-AI Collaboration for Generating Free-Text Explanationscited by 125
  8. 2024Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizercited by 109
  9. 2023SCOTT: Self-Consistent Chain-of-Thought Distillationcited by 103
  10. 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agentscited by 41
  11. 2024Keypoint-based Progressive Chain-of-Thought Distillation for LLMscited by 22
  12. 2023Instructed Language Models with Retrievers Are Powerful Entity Linkerscited by 18
  13. 2024Investigating Mysteries of CoT-Augmented Distillationcited by 15
  14. 2024OneNet: A Fine-Tuning Free Framework for Few-Shot Entity Linking via Large Language Model Promptingcited by 9
  15. 2024EntGPT: Entity Linking with Generative Large Language Modelscited by 6
  16. 2025Leveraging the Power of Large Language Models in Entity Linking via Adaptive Routing and Targeted Reasoningcited by 4
  17. 2022Entity Linking in Tabular Data Needs the Right Attentioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Improving Table Understanding with LLMs and Entity-Oriented Search
  2. 2026Learning Chain Of Thoughts Prompts for Predicting Entities, Relations, and even Literals on Knowledge Graphs
  3. 2024Learning from Natural Language Explanations for Generalizable Entity Matching
  4. 2026Enhancing Table Reasoning with Deterministic Table-State Rewards
  5. 2026Polaris: Learning to Generate Table Descriptions from Retrieval Feedback
  6. 2025Audited Reasoning Refinement: Fine-Tuning Language Models via LLM-Guided Step-Wise Evaluation and Correction
  7. 2026ChainPrune: Evaluating and Reducing Redundancy in Long Chain-of-Thought Reasoning
  8. 2026Think Before You Link: Rarity, Reasoning, and Retrieval in Multilingual Entity Linking