mlsanityData to 7 Oct 2026

GLEAN: Grounded Lightweight Evaluation Anchors for Contamination-Aware Tabular Reasoning

arXiv 2603.02212 ↗First posted 22 Jan 2026cs.DB cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Tabular reasoning benchmarks mix semantic inference, numerical computation, and brittle table formatting, yet evaluations for small models remain vulnerable to contamination, dataset artifacts, and retrieval failures. We propose GLEAN, a lightweight evaluation protocol that integrates contamination-aware probes, weak-supervision governance, retrieval-reasoning diagnostics, and structured error attribution under tight hardware constraints. We evaluate across TabFact, WTQ via Squall, TableBench, RobuT, and SciTab under a 16GB GPU budget. Using Squall gold SQL as an executable anchor (95.2% execution), GLEAN assigns a deterministic error taxonomy (L0-L4 plus L0.5 context miss) and reveals a stable error-mode separation: TAPEX errors skew toward grounding (L3) while TAPAS errors skew toward hallucination/abstention (L2/L0). We validate evidence-row heuristics against SQL-derived rows on simple queries (0.62 precision / 0.71 recall; hybrid recall 0.81) and show that retrieval Recall@K can saturate even when end-to-end EM/F1 remains limited, motivating attribution beyond raw recall. We release a modular framework with audits and sensitivity checks to make small-model tabular evaluation more contamination-aware and diagnostic.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

23 of 36 references.

References · 23

  1. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  2. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  3. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
  4. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  5. 2017Snorkel: Rapid Training Data Creation with Weak Supervisioncited by 370
  6. 2021TAPEX: Table Pre-training via Learning a Neural SQL Executorcited by 233
  7. 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 136
  8. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
  9. 2024Benchmarking Benchmark Leakage in Large Language Modelscited by 102
  10. 2021WRENCH: A Comprehensive Benchmark for Weak Supervisioncited by 95
  11. 2024TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarioscited by 76
  12. 2020On the Potential of Lexico-logical Alignments for Semantic Parsing to SQL Queriescited by 59
11 more
  1. 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
  2. 2024AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledgecited by 42
  3. 2025Table-R1: Inference-Time Scaling for Table Reasoningcited by 23
  4. 2025TableMind: An Autonomous Programmatic Agent for Tool-Augmented Table Reasoningcited by 19
  5. 2025TableEval: A Real-World Benchmark for Complex, Multilingual, and Multi-Structured Table Question Answeringcited by 14
  6. 2025LastingBench: Defend Benchmarks Against Knowledge Leakagecited by 14
  7. 2025Tailoring Table Retrieval from a Field-aware Hybrid Matching Perspectivecited by 7
  8. 2025Towards Question Answering over Large Semi-structured Tablescited by 2
  9. 2025Node-Level Uncertainty Estimation in LLM-Generated SQLcited by 2
  10. 2025Beyond Query-Level Comparison: Fine-Grained Reinforcement Learning for Text-to-SQL with Automated Interpretable Critiquescited by 2
  11. 2025What to Keep and What to Drop: Adaptive Table Filtering Frameworkcited by 1

Built on by

Not cited yet.