mlsanityData to 7 Oct 2026

MERGED: Multimodal Entity Resolution via Generated Expert Reasoning Distillation

arXiv 2609.01913 ↗First posted 1 Sep 2026cs.IRcited by 0

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

In product entity resolution, relationship definitions constantly evolve with business needs, yet adapting to each change traditionally requires slow, costly human annotation that is often noisy and carries no reasoning. Large vision-language models (VLMs) prompted zero-shot can adapt to a new definition immediately and supply the reasoning that human labels lack, but their cost and latency are prohibitive at production scale. We present MERGED, a distillation framework that transfers not just labels but structured reasoning from large teacher VLMs into a compact 7B-parameter student, requiring no human annotation for training. Multiple teachers label each product pair and articulate the reasoning behind their decision: agreement pairs supply supervised fine-tuning, while disagreements are resolved by a meta-judge into preference pairs for Direct Preference Optimization. Evaluated against human-labeled ground truth on a multilingual e-commerce dataset, the resulting student improves PR-AUC by 13.79% over the same backbone trained on human labels and surpasses the larger Qwen2.5-32B-VL baseline by 6.32% at 6x lower cost, while also yielding tighter label-reasoning consistency (over 10% above Qwen2.5-32B-VL). Moreover, re-applying MERGED from an existing checkpoint adapts to a new relationship definition with only 10K samples, improving PR-AUC by 6.97% over zero-shot and outperforming from-scratch training. MERGED enables rapid adaptation to evolving relationship definitions, supporting a new one in days rather than months, at a cost and latency suitable for large-scale industrial deployment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 7 of its 21 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

7 of 21 references.

References · 7

  1. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
  2. 2025LIMO: Less is More for Reasoningcited by 488
  3. 2024Generative Reward Modelscited by 148
  4. 2024Self-Taught Evaluatorscited by 70
  5. 2025Enhancing LLM Reasoning with Iterative DPO: A Comprehensive Empirical Investigationcited by 36
  6. 2023Entity Matching using Large Language Modelscited by 31
  7. 2025Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMscited by 25

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce
  2. 2026Retrieve, Match, Escalate: Accurate and Scalable Product Linking with VLM-Distilled Cross-Encoders and Agentic VLMs
  3. 2026Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation
  4. 2026MOON3.0: Reasoning-aware Multimodal Representation Learning for E-commerce Product Understanding
  5. 2025MOON2.0: Dynamic Modality-balanced Multimodal Representation Learning for E-commerce Product Understanding
  6. 2025MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understanding
  7. 2025Audited Reasoning Refinement: Fine-Tuning Language Models via LLM-Guided Step-Wise Evaluation and Correction
  8. 2023Chain-of-Thought Prompt Distillation for Multimodal Named Entity Recognition and Multimodal Relation Extraction