SpreadsheetCoder: Formula Prediction from Semi-structured Context
Not on the map. Why?
Abstract (arXiv)
Spreadsheet formula prediction has been an important program synthesis problem with many real-world applications. Previous works typically utilize input-output examples as the specification for spreadsheet formula synthesis, where each input-output pair simulates a separate row in the spreadsheet. However, this formulation does not fully capture the rich context in real-world spreadsheets. First, spreadsheet data entries are organized as tables, thus rows and columns are not necessarily independent from each other. In addition, many spreadsheet tables include headers, which provide high-level descriptions of the cell data. However, previous synthesis approaches do not consider headers as part of the specification. In this work, we present the first approach for synthesizing spreadsheet formulas from tabular context, which includes both headers and semi-structured tabular data. In particular, we propose SpreadsheetCoder, a BERT-based model architecture to represent the tabular context in both row-based and column-based formats. We train our model on a large dataset of spreadsheets, and demonstrate that SpreadsheetCoder achieves top-1 prediction accuracy of 42.51%, which is a considerable improvement over baselines that do not employ rich tabular context. Compared to the rule-based system, SpreadsheetCoder assists 82% more users in composing formulas on Google Sheets.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). Builds on 25 of its 55 references that are in the map. First posted on arXiv 26 Jun 2021.
Builds on
25 of 55 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
- 2020IntelliCode Compose: Code Generation Using Transformercited by 225
- 2018Learning to Mine Aligned Code and Natural Language Pairs from Stack Overflowcited by 165
- 2015Visualizing and Understanding Recurrent Networkscited by 158
- 2016DeepCoder: Learning to Write Programscited by 145
13 more
- 2017RobustFill: Neural Program Learning under Noisy I/Ocited by 124
- 2018Coarse-to-Fine Decoding for Neural Semantic Parsingcited by 110
- 2018NL2Bash: A Corpus and Semantic Parser for Natural Language Interface to the Linux Operating Systemcited by 97
- 2016Neuro-Symbolic Program Synthesiscited by 84
- 2018Leveraging Grammar and Reinforcement Learning for Neural Program Synthesiscited by 83
- 2018Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsingcited by 57
- 2019Pythia: AI-assisted Code Completion Systemcited by 54
- 2017Code Completion with Neural Attention and Pointer Networkscited by 49
- 2019Learning to Infer Program Sketchescited by 44
- 2018Neural-Guided Deductive Search for Real-Time Program Synthesis from Examplescited by 39
- 2020Fast and Memory-Efficient Neural Code Completioncited by 38
- 2020BUSTLE: Bottom-Up Program Synthesis Through Learning-Guided Explorationcited by 30
- 2021TableSense: Spreadsheet Table Detection with Convolutional Neural Networkscited by 12
Built on by
Citing papers per year: 2021: 2; 2022: 6; 2023: 8; 2024: 11; 2025: 11; 2026: 3.
41 papers.
Sort:
By area:
- 2023FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUcited by 567
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2024MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decodingcited by 87
- 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
- 2024Symbolic Regression with a Learned Concept Librarycited by 76
- 2024MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUscited by 73
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Modelscited by 53
- 2024Large Language Model for Table Processing: A Surveycited by 52
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2024Is Programming by Example solved by LLMs?cited by 27
29 more
- 2022Table-To-Text generation and pre-training with TabT5cited by 20
- 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretrainingcited by 19
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2023FLAME: A small language model for spreadsheet formulascited by 15
- 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Modelscited by 15
- 2023InstructExcel: A Benchmark for Natural Language Instruction in Excelcited by 14
- 2023A Hardware Evaluation Framework for Large Language Model Inferencecited by 14
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmarkcited by 13
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representationscited by 12
- 2025HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-locationcited by 10
- 2024NL2Formula: Generating Spreadsheet Formulas from Natural Language Queriescited by 8
- 2023FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Languagecited by 7
- 2025General Table Question Answering via Answer-Formula Joint Generationcited by 7
- 2023Generating Pragmatic Examples to Train Neural Program Synthesizerscited by 5
- 2025TableTalk: Scaffolding Spreadsheet Development with a Language Agentcited by 5
- 2022CORNET: Learning Table Formatting Rules By Examplecited by 4
- 2025Program Synthesis via Test-Time Transductioncited by 4
- 2025Efficient LLM Inference with Activation Checkpointing and Hybrid Cachingcited by 3
- 2025MoE-Lens: Towards the Hardware Limit of High-Throughput MoE LLM Serving Under Resource Constraintscited by 3
- 2025Formula-R1: Incentivizing LLM Reasoning over Complex Tables with Numerical Computation via Formula-Driven Reinforcement Learningcited by 3
- 2023Neuro-Symbolic Execution of Generic Source Codecited by 1
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operationscited by 1
- 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbookscited by 1
- 2022Iterative Genetic Improvement: Scaling Stochastic Program Synthesiscited by 0
- 2024An Empirical Study of Validating Synthetic Data for Formula Generationcited by 0
- 2025Tabularis Formatus: Predictive Formatting for Tablescited by 0
- 2025Benchmark Dataset Generation and Evaluation for Excel Formula Repair with LLMscited by 0
- 2026A Benchmark and Framework for Evaluating Next Action Predictions in Spreadsheetscited by 0
- 2026CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMscited by 0
- 2026CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs29 Jun 2026
- 2026A Benchmark and Framework for Evaluating Next Action Predictions in Spreadsheets11 Jun 2026
- 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbooks16 Feb 2026
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operations22 Oct 2025
- 2025Program Synthesis via Test-Time Transduction22 Sep 2025
- 2025Benchmark Dataset Generation and Evaluation for Excel Formula Repair with LLMs14 Aug 2025
- 2025Tabularis Formatus: Predictive Formatting for Tables14 Aug 2025
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark5 Jun 2025
- 2025Formula-R1: Incentivizing LLM Reasoning over Complex Tables with Numerical Computation via Formula-Driven Reinforcement Learning29 May 2025
- 2025MoE-Lens: Towards the Hardware Limit of High-Throughput MoE LLM Serving Under Resource Constraints12 Apr 2025
- 2025General Table Question Answering via Answer-Formula Joint Generation16 Mar 2025
- 2025TableTalk: Scaffolding Spreadsheet Development with a Language Agent13 Feb 2025
29 more
- 2025HyGen: Efficient LLM Serving via Elastic Online-Offline Request Co-location15 Jan 2025
- 2025Efficient LLM Inference with Activation Checkpointing and Hybrid Caching3 Jan 2025
- 2024MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs18 Nov 2024
- 2024Symbolic Regression with a Learned Concept Library14 Sep 2024
- 2024MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding20 Aug 2024
- 2024An Empirical Study of Validating Synthetic Data for Formula Generation15 Jul 2024
- 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Models12 Jul 2024
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation21 Jun 2024
- 2024Is Programming by Example solved by LLMs?12 Jun 2024
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representations19 Apr 2024
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models6 Mar 2024
- 2024NL2Formula: Generating Spreadsheet Formulas from Natural Language Queries20 Feb 2024
- 2024Large Language Model for Table Processing: A Survey4 Feb 2024
- 2023A Hardware Evaluation Framework for Large Language Model Inference5 Dec 2023
- 2023Generating Pragmatic Examples to Train Neural Program Synthesizers9 Nov 2023
- 2023FormaT5: Abstention and Examples for Conditional Table Formatting with Natural Language26 Oct 2023
- 2023InstructExcel: A Benchmark for Natural Language Instruction in Excel23 Oct 2023
- 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Models30 May 2023
- 2023Neuro-Symbolic Execution of Generic Source Code23 Mar 2023
- 2023FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU13 Mar 2023
- 2023FLAME: A small language model for spreadsheet formulas31 Jan 2023
- 2022Natural Language to Code Generation in Interactive Data Science Notebooks19 Dec 2022
- 2022Table-To-Text generation and pre-training with TabT517 Oct 2022
- 2022CORNET: Learning Table Formatting Rules By Example11 Aug 2022
- 2022InCoder: A Generative Model for Code Infilling and Synthesis12 Apr 2022
- 2022Iterative Genetic Improvement: Scaling Stochastic Program Synthesis26 Feb 2022
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks24 Jan 2022
- 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretraining15 Sep 2021
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policies31 Aug 2021
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmarkcited by 13
- 2025Formula-R1: Incentivizing LLM Reasoning over Complex Tables with Numerical Computation via Formula-Driven Reinforcement Learningcited by 3
- 2025MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark5 Jun 2025
- 2025Formula-R1: Incentivizing LLM Reasoning over Complex Tables with Numerical Computation via Formula-Driven Reinforcement Learning29 May 2025
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Models6 Mar 2024
- 2023FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUcited by 567
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
- 2024Symbolic Regression with a Learned Concept Librarycited by 76
- 2021Learning to Synthesize Programs as Interpretable and Generalizable Policiescited by 59
- 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Modelscited by 53
- 2024Large Language Model for Table Processing: A Surveycited by 52
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2024Is Programming by Example solved by LLMs?cited by 27
- 2022Table-To-Text generation and pre-training with TabT5cited by 20
- 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretrainingcited by 19
12 most cited of 31 All 31 (JSON)
- 2026CITBench: A Comprehensive Benchmark for Interactive Tabular Data Processing with LLMs29 Jun 2026
- 2026A Benchmark and Framework for Evaluating Next Action Predictions in Spreadsheets11 Jun 2026
- 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbooks16 Feb 2026
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operations22 Oct 2025
- 2025Program Synthesis via Test-Time Transduction22 Sep 2025
- 2025Benchmark Dataset Generation and Evaluation for Excel Formula Repair with LLMs14 Aug 2025
- 2025Tabularis Formatus: Predictive Formatting for Tables14 Aug 2025
- 2025General Table Question Answering via Answer-Formula Joint Generation16 Mar 2025
- 2024Symbolic Regression with a Learned Concept Library14 Sep 2024
- 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Models12 Jul 2024
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation21 Jun 2024
- 2024Is Programming by Example solved by LLMs?12 Jun 2024
12 newest of 31 All 31 (JSON)