LyS at SemEval 2025 Task 8: Zero-Shot Code Generation for Tabular QA
Not on the map. Why?
Abstract (arXiv)
This paper describes our participation in SemEval 2025 Task 8, focused on Tabular Question Answering. We developed a zero-shot pipeline that leverages an Large Language Model to generate functional code capable of extracting the relevant information from tabular data based on an input question. Our approach consists of a modular pipeline where the main code generator module is supported by additional components that identify the most relevant columns and analyze their data types to improve extraction accuracy. In the event that the generated code fails, an iterative refinement process is triggered, incorporating the error feedback into a new generation prompt to enhance robustness. Our results show that zero-shot code generation is a valid approach for Tabular QA, achieving rank 33 of 53 in the test phase despite the lack of task-specific fine-tuning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
13 of 27 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 398
- 2018TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generationcited by 81
- 2023MultiTabQA: Generating Tabular Answers for Multi-Table Question Answeringcited by 32
- 2022TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Datacited by 19
1 more
Built on by
Citing papers per year: 2025: 1.
1 paper.