MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalisms
Not on the map. Why?
Cited by 171 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We introduce a large-scale dataset of math word problems and an interpretable neural math problem solver that learns to map problems to operation programs. Due to annotation challenges, current datasets in this domain have been either relatively small in scale or did not offer precise operational annotations over diverse problem types. We introduce a new representation language to model precise operation programs corresponding to each math problem that aim to improve both the performance and the interpretability of the learned models. Using this representation language, our new dataset, MathQA, significantly enhances the AQuA dataset with fully-specified operational programs. We additionally introduce a neural sequence-to-program model enhanced with automatic problem categorization. Our experiments show improvements over competitive baselines in our MathQA as well as the AQuA dataset. The results are still significantly lower than human performance indicating that the dataset poses new challenges for future research. Our dataset is available at: https://math-qa.github.io/math-QA/
Key facts. Cited by 662 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 56; 2023: 74; 2024: 176; 2025: 217; 2026: 109.
662 papers.
Sort:
By area:
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023A Survey of Large Language Modelscited by 2,576
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
38 more
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2022PAL: Program-aided Language Modelscited by 652
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 333
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2021A Diverse Corpus for Evaluating and Developing English Math Word Problem Solverscited by 318
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
- 2023Large Language Models as Tool Makerscited by 303
- 2023Tool Learning with Foundation Modelscited by 302
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 286
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
- 2023Mathematical Capabilities of ChatGPTcited by 268
- 2022Reasoning with Language Model Prompting: A Surveycited by 252
- 2024SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compressioncited by 243
- 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
- 2022FOLIO: Natural Language Reasoning with First-Order Logiccited by 235
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 205
- 2022TALM: Tool Augmented Language Modelscited by 197
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
- 2024Are We Done with MMLU?cited by 194
- 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
50 most cited of 662 All 662 (JSON)
- 2026Frustratingly Easy Majority Voting Using Length Conditioning14 Oct 2026
- 2026DAGFormer: Global Topology Prediction for Transformer Cross-Layer Connections14 Oct 2026
- 2026Soft Teacher Forcing12 Oct 2026
- 2026FunDM: Cheap & Label-Free Decision Models from Frozen Language Models12 Oct 2026
- 2026The Bell Boundary of Shared Representations12 Oct 2026
- 2026Towards Robust Calibration Dataset for Domain-General Mixture of Experts Pruning11 Oct 2026
- 2026Function-Structured Reinforcement Learning with Executable Verifiers for Mathematical Reasoning1 Oct 2026
- 2026Learning Functional Subspaces for Neural Network Compression30 Sep 2026
- 2026Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection29 Sep 2026
- 2026Generalizable Lifelong Model Editing via Preference Optimization29 Sep 2026
- 2026Toward Embedding-Based Psychometrics: Structural Modeling of Assessment-Item Semantics With Contextual Scores25 Sep 2026
- 2026DeepEdu-v1: Efficient and Scalable Agentic LLMs for Vietnamese Education25 Sep 2026
38 more
- 2026MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression24 Sep 2026
- 2026Math Reasoning in LLMs is Organized by Approach, Not Topic22 Sep 2026
- 2026SupportCal: Label-Free Calibration of Post-Trained LLMs via Reference Support and Corroboration21 Sep 2026
- 2026Layer-wise Curriculum Learning for Efficient LLM Compression16 Sep 2026
- 2026Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing16 Sep 2026
- 2026FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inference15 Sep 2026
- 2026Train Overcomplete, Deploy Compact: Scaling Recovery Capacity for Structured LLM Pruning7 Sep 2026
- 2026Behaviorally Effective LoRA Writes Are Sparse and Structured1 Sep 2026
- 2026Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study29 Aug 2026
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026LowRankArena: A Standardized Evaluation Platform for SVD-Based LLM Compression26 Aug 2026
- 2026CAI-DLLM: Convergence Aware Inference for Diffusion Language Models23 Aug 2026
- 2026Unifying Depth and Width Pruning for LLMs via Binary Knapsack Optimization13 Aug 2026
- 2026Quantization Degradation in Large Language Models: A Signal-Noise Perspective8 Aug 2026
- 2026The Sparsity Whisperer6 Aug 2026
- 2026Conformal Cascade: Distribution-Free Accuracy Guarantees for Multi-Tier LLM Inference27 Jul 2026
- 2026Length Penalties Make Chain-of-Thought Less Monitorable8 Jul 2026
- 2026Parameter-Free Encoders Remain Viable for RDB Foundation Models6 Jul 2026
- 2026GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache1 Jul 2026
- 2026CuraWeb: Joint Optimization of Quality, Redundancy, and Diversity for Web-Scale Pretraining Data29 Jun 2026
- 2026Invariant Reasoning Directions in Latent Trajectories of Language Models28 Jun 2026
- 2026FlexMoE: One-for-All Nested Intra-Expert Pruning for MoE Language Models26 Jun 2026
- 2026Activation- and Influence-Aware Ranks (AIR): Function-Preserving SVD Compression for LLMs18 Jun 2026
- 2026BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training17 Jun 2026
- 2026SciText2Eq: Assessing LLMs for Explainable Equation Generation for Scientific Creativity14 Jun 2026
- 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery7 Jun 2026
- 2026MemToolAgent: Leveraging Memory for Tool Using Agents Based on Environment and User Feedback6 Jun 2026
- 2026Predictable Scaling Laws of Optimal Hyperparameters for LLM Continued Pre-training4 Jun 2026
- 2026CrowdMath: A Dataset of Crowdsourced Mathematical Research Discussions2 Jun 2026
- 2026The Routing Plateau: Understanding the Accuracy Limits of LLM Routers27 May 2026
- 2026BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization22 May 2026
- 2026Strong Teacher Not Needed? On Distillation in LLM Pretraining22 May 2026
- 2026Diagnosing Multi-step Reasoning Failures in Black-box LLMs via Stepwise Confidence Attribution19 May 2026
- 2026Can Vision Language Models Be Adaptive in Mathematics Education? A Learner Model-based Rubric Study15 May 2026
- 2026IO-SVD: Input-Output Whitened SVD for Adaptive-Rank LLM Compression15 May 2026
- 2026Know When To Fold 'Em: Token-Efficient LLM Synthetic Data Generation via Multi-Stage In-Flight Rejection13 May 2026
- 2026Relative Kinetic Utility for Reasoning-Aware Structural Pruning in Large Language Models9 May 2026
- 2026Fitting Is Not Enough: Smoothness in Extremely Quantized LLMs9 May 2026
50 newest of 662 All 662 (JSON)
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2022PAL: Program-aided Language Modelscited by 652
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 415
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 388
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 350
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
12 most cited of 171 All 171 (JSON)
- 2026Frustratingly Easy Majority Voting Using Length Conditioning14 Oct 2026
- 2026Soft Teacher Forcing12 Oct 2026
- 2026Function-Structured Reinforcement Learning with Executable Verifiers for Mathematical Reasoning1 Oct 2026
- 2026Math Reasoning in LLMs is Organized by Approach, Not Topic22 Sep 2026
- 2026Length Penalties Make Chain-of-Thought Less Monitorable8 Jul 2026
- 2026Invariant Reasoning Directions in Latent Trajectories of Language Models28 Jun 2026
- 2026Artificial Intelligence for Mathematical Reasoning: An Integrated Survey of Language Models, Neuro-symbolic Systems, and Verified Discovery7 Jun 2026
- 2026CrowdMath: A Dataset of Crowdsourced Mathematical Research Discussions2 Jun 2026
- 2026Diagnosing Multi-step Reasoning Failures in Black-box LLMs via Stepwise Confidence Attribution19 May 2026
- 2026Relative Kinetic Utility for Reasoning-Aware Structural Pruning in Large Language Models9 May 2026
- 2026TEMPER: Testing Emotional Perturbation in Quantitative Reasoning9 Apr 2026
- 2026Identifying Influential N-grams in Confidence Calibration via Regression Analysis7 Apr 2026
12 newest of 171 All 171 (JSON)
- 2025MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidancecited by 34
- 2025Delta Decompression for MoE-based LLMs Compressioncited by 33
- 2024Shortcut-connected Expert Parallelism for Accelerating Mixture-of-Expertscited by 32
- 2025EAC-MoE: Expert-Selection Aware Compressor for Mixture-of-Experts Large Language Modelscited by 18
- 2022Eliciting and Understanding Cross-Task Skills with Task-Level Mixture-of-Expertscited by 12
- 2024DLO: Dynamic Layer Operation for Efficient Vertical Scaling of LLMscited by 10
- 2025Learning Compact Representations of LLM Abilities via Item Response Theorycited by 10
- 2026Effective MoE-based LLM Compression by Exploiting Heterogeneous Inter-Group Experts Routing Frequency and Information Densitycited by 7
- 2025Continual Pre-training of MoEs: How robust is your router?cited by 5
- 2024MoC-System: Efficient Fault Tolerance for Sparse Mixture-of-Experts Model Trainingcited by 4
- 2025Occult: Optimizing Collaborative Communication across Experts for Accelerated Parallel MoE Training and Inferencecited by 4
- 2026Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inferencecited by 4
12 most cited of 27 All 27 (JSON)
- 2026Towards Robust Calibration Dataset for Domain-General Mixture of Experts Pruning11 Oct 2026
- 2026Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing16 Sep 2026
- 2026FlexMoE: One-for-All Nested Intra-Expert Pruning for MoE Language Models26 Jun 2026
- 2026BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization22 May 2026
- 2026Knowledge Injection Exists in MoE? Exploring Expert-Aware Contrast Decoding in MoE for Mitigating LLMs'Hallucinations8 May 2026
- 2026Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference9 Apr 2026
- 2026Efficient Quantization of Mixture-of-Experts with Theoretical Generalization Guarantees7 Apr 2026
- 2026Robust Heterogeneous Analog-Digital Computing for Mixture-of-Experts Models with Theoretical Generalization Guarantees3 Mar 2026
- 2026Effective MoE-based LLM Compression by Exploiting Heterogeneous Inter-Group Experts Routing Frequency and Information Density10 Feb 2026
- 2025Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation18 Dec 2025
- 2025Context-Aware Mixture-of-Experts Inference on CXL-Enabled GPU-NDP Systems4 Dec 2025
- 2025Learning Compact Representations of LLM Abilities via Item Response Theory1 Oct 2025
12 newest of 27 All 27 (JSON)
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2024MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Modelscited by 34
- 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
- 2025FaceXBench: Evaluating Multimodal LLMs on Face Understandingcited by 24
- 2025Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Modelscited by 22
- 2025Valley2: Exploring Multimodal Models with Scalable Vision-Language Designcited by 21
- 2025SAIL-VL2 Technical Reportcited by 14
- 2025MATP-BENCH: Can MLLM Be a Good Automated Theorem Prover for Multimodal Problems?cited by 13
12 most cited of 25 All 25 (JSON)
- 2026Can Vision Language Models Be Adaptive in Mathematics Education? A Learner Model-based Rubric Study15 May 2026
- 2025Same or Not? Enhancing Visual Perception in Vision-Language Models29 Dec 2025
- 2025SAIL-VL2 Technical Report17 Sep 2025
- 2025SAILViT: Towards Robust and Generalizable Visual Backbones for MLLMs via Gradual Feature Refinement2 Jul 2025
- 2025CoMemo: LVLMs Need Image Context with Image Memory6 Jun 2025
- 2025MATP-BENCH: Can MLLM Be a Good Automated Theorem Prover for Multimodal Problems?6 Jun 2025
- 2025MANBench: Is Your Multimodal Model Smarter than Human?4 Jun 2025
- 2025Data Metabolism: An Efficient Data Design Schema For Vision Language Model10 Apr 2025
- 2025Capybara-OMNI: An Efficient Paradigm for Building Omni-Modal Language Models10 Apr 2025
- 2025Breaking Language Barriers in Visual Language Models via Multilingual Textual Regularization28 Mar 2025
- 2025MathFlow: Enhancing the Perceptual Flow of MLLMs for Visual Mathematical Problems19 Mar 2025
- 2025GenieBlue: Integrating both Linguistic and Multimodal Capabilities for Large Language Models on Mobile Devices8 Mar 2025
12 newest of 25 All 25 (JSON)
- 2023Large Language Models as Tool Makerscited by 303
- 2023Tool Learning with Foundation Modelscited by 302
- 2022TALM: Tool Augmented Language Modelscited by 197
- 2024AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectoriescited by 56
- 2024NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Callscited by 48
- 2024LLM Harmony: Multi-Agent Communication for Problem Solvingcited by 35
- 2024Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoningcited by 16
- 2025LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactionscited by 16
- 2024WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Modelscited by 13
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problemscited by 12
- 2025Self-Taught Agentic Long Context Understandingcited by 10
- 2025A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Toolscited by 7
12 most cited of 20 All 20 (JSON)
- 2026DeepEdu-v1: Efficient and Scalable Agentic LLMs for Vietnamese Education25 Sep 2026
- 2026MemToolAgent: Leveraging Memory for Tool Using Agents Based on Environment and User Feedback6 Jun 2026
- 2026Cross-Modal Memory Compression for Efficient Multi-Agent Debate31 Jan 2026
- 2025RefGrader: Automated Grading of Mathematical Competition Proofs using Agentic Workflows10 Oct 2025
- 2025EduPersona: Benchmarking Subjective Ability Boundaries of Virtual Student Agents6 Oct 2025
- 2025Self-Improvement of Language Models by Post-Training on Multi-Agent Debate18 Sep 2025
- 2025LLMs Can't Handle Peer Pressure: Crumbling under Multi-Agent Social Interactions24 Aug 2025
- 2025Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training21 Jul 2025
- 2025A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Tools25 Jun 2025
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problems12 Jun 2025
- 2025StepMathAgent: A Step-Wise Agent for Evaluating Mathematical Processes through Tree-of-Error13 Mar 2025
- 2025Self-Taught Agentic Long Context Understanding21 Feb 2025
12 newest of 20 All 20 (JSON)
- 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Modelscited by 437
- 2024The Butterfly Effect of Altering Prompts: How Small Changes and Jailbreaks Affect Large Language Model Performancecited by 100
- 2024Machine Unlearning in Generative AI: A Surveycited by 49
- 2024To Each (Textual Sequence) Its Own: Improving Memorized-Data Unlearning in Large Language Modelscited by 43
- 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methodscited by 40
- 2024Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Modelscited by 39
- 2024Split, Unlearn, Merge: Leveraging Data Attributes for More Effective Unlearning in LLMscited by 18
- 2024Protecting Privacy Through Approximating Optimal Parameters for Sequence Unlearning in Language Modelscited by 10
- 2025Self-Destructive Language Modelcited by 10
- 2025Forgetting to Forget: Attention Sink as A Gateway for Backdooring LLM Unlearningcited by 6
- 2024Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Modelscited by 5
- 2025Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosiscited by 5
12 most cited of 18 All 18 (JSON)
- 2026MirageBackdoor: A Stealthy Attack that Induces Think-Well-Answer-Wrong Reasoning8 Apr 2026
- 2026Exclusive Unlearning7 Apr 2026
- 2025A Survey on Unlearning in Large Language Models29 Oct 2025
- 2025Forgetting to Forget: Attention Sink as A Gateway for Backdooring LLM Unlearning19 Oct 2025
- 2025LLM Unlearning Under the Microscope: A Full-Stack View on Methods and Metrics8 Oct 2025
- 2025Concept Concentration for Faithful Representation Intervention24 May 2025
- 2025Self-Destructive Language Model18 May 2025
- 2025Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis19 Feb 2025
- 2024WPN: An Unlearning Method Based on N-pair Contrastive Learning in Language Models18 Aug 2024
- 2024Machine Unlearning in Generative AI: A Survey30 Jul 2024
- 2024Learn while Unlearn: An Iterative Unlearning Framework for Generative Language Models25 Jul 2024
- 2024Protecting Privacy Through Approximating Optimal Parameters for Sequence Unlearning in Language Models20 Jun 2024
12 newest of 18 All 18 (JSON)
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 832
- 2024MiniCache: KV Cache Compression in Depth Dimension for Large Language Modelscited by 125
- 2024QAQ: Quality Adaptive Quantization for LLM KV Cachecited by 66
- 2025PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inferencecited by 14
- 2024A2SF: Accumulative Attention Scoring with Forgetting Factor for Token Pruning in Transformer Decodercited by 8
- 2025Saliency-driven Dynamic Token Pruning for Large Language Modelscited by 5
- 2025GTA: Grouped-head latenT Attentioncited by 3
- 2025AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Modelscited by 3
- 2025FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inferencecited by 2
- 2026Swift-SVD: Theoretical Optimality Meets Practical Efficiency in Low-Rank LLM Compressioncited by 2
- 2026GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cachecited by 0
- 2026FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inferencecited by 0
12 most cited of 13 All 13 (JSON)
- 2026MILO: Efficient Many-shot In-Context Learning with Block-wise Low-rank Compression24 Sep 2026
- 2026FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inference15 Sep 2026
- 2026GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache1 Jul 2026
- 2026Swift-SVD: Theoretical Optimality Meets Practical Efficiency in Low-Rank LLM Compression2 Apr 2026
- 2025FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inference10 Oct 2025
- 2025PDTrim: Targeted Pruning for Prefill-Decode Disaggregation in Inference29 Aug 2025
- 2025AnTKV: Anchor Token-Aware Sub-Bit Vector Quantization for KV Cache in Large Language Models24 Jun 2025
- 2025GTA: Grouped-head latenT Attention15 Jun 2025
- 2025Saliency-driven Dynamic Token Pruning for Large Language Models6 Apr 2025
- 2024A2SF: Accumulative Attention Scoring with Forgetting Factor for Token Pruning in Transformer Decoder30 Jul 2024
- 2024MiniCache: KV Cache Compression in Depth Dimension for Large Language Models23 May 2024
- 2024QAQ: Quality Adaptive Quantization for LLM KV Cache7 Mar 2024
12 newest of 13 All 13 (JSON)
- 2024Spectral Editing of Activations for Large Language Model Alignmentcited by 56
- 2024Self-Boosting Large Language Models with Synthetic Preference Datacited by 40
- 2025Translate Policy to Language: Flow Matching Generated Rewards for LLM Explanationscited by 6
- 2025The Hidden Link Between RLHF and Contrastive Learningcited by 5
- 2024Learning Goal-Conditioned Representations for Language Reward Modelscited by 2
- 2025Listwise Direct Preference Optimization with Multi-Dimensional Preference Mixingcited by 2
- 2025Contrastive Weak-to-strong Generalizationcited by 2
- 2025Offline Preference Optimization via Maximum Marginal Likelihood Estimationcited by 1
- 2026Generalizable Lifelong Model Editing via Preference Optimizationcited by 0
- 2026Generalizable Lifelong Model Editing via Preference Optimization29 Sep 2026
- 2025Offline Preference Optimization via Maximum Marginal Likelihood Estimation27 Oct 2025
- 2025Contrastive Weak-to-strong Generalization9 Oct 2025
- 2025The Hidden Link Between RLHF and Contrastive Learning27 Jun 2025
- 2025Listwise Direct Preference Optimization with Multi-Dimensional Preference Mixing24 Jun 2025
- 2025Translate Policy to Language: Flow Matching Generated Rewards for LLM Explanations18 Feb 2025
- 2024Self-Boosting Large Language Models with Synthetic Preference Data9 Oct 2024
- 2024Learning Goal-Conditioned Representations for Language Reward Models18 Jul 2024
- 2024Spectral Editing of Activations for Large Language Model Alignment15 May 2024
- 2024Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Samplingcited by 90
- 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Applicationcited by 56
- 2024LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Modelscited by 4
- 2023ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalizationcited by 3
- 2026Strong Teacher Not Needed? On Distillation in LLM Pretrainingcited by 3
- 2024Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Modelscited by 0
- 2025A Diversity-Enhanced Knowledge Distillation Model for Practical Math Word Problem Solvingcited by 0
- 2026Strong Teacher Not Needed? On Distillation in LLM Pretraining22 May 2026
- 2025A Diversity-Enhanced Knowledge Distillation Model for Practical Math Word Problem Solving7 Jan 2025
- 2024Dynamic Self-Distillation via Previous Mini-batches for Fine-tuning Small Language Models25 Nov 2024
- 2024LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models11 Nov 2024
- 2024Speculative Knowledge Distillation: Bridging the Teacher-Student Gap Through Interleaved Sampling15 Oct 2024
- 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application2 Jul 2024
- 2023ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization9 Jan 2023
- 2024Mitigating Tail Narrowing in LLM Self-Improvement via Socratic-Guided Samplingcited by 13
- 2023Multi-Method Self-Training: Improving Code Generation With Text, And Vice Versacited by 0
- 2024Direct-Inverse Prompting: Analyzing LLMs' Discriminative Capacity in Self-Improving Generationcited by 0
- 2025Balancing Synthetic Data and Replay for Enhancing Task-Specific Capabilitiescited by 0
- 2026Know When To Fold 'Em: Token-Efficient LLM Synthetic Data Generation via Multi-Stage In-Flight Rejectioncited by 0
- 2026Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Studycited by 0
- 2026Quantifying Error Tolerance in Synthetic Data: An Atomic-level Operand vs. Operator Perturbation Study29 Aug 2026
- 2026Know When To Fold 'Em: Token-Efficient LLM Synthetic Data Generation via Multi-Stage In-Flight Rejection13 May 2026
- 2025Balancing Synthetic Data and Replay for Enhancing Task-Specific Capabilities13 Oct 2025
- 2024Mitigating Tail Narrowing in LLM Self-Improvement via Socratic-Guided Sampling1 Nov 2024
- 2024Direct-Inverse Prompting: Analyzing LLMs' Discriminative Capacity in Self-Improving Generation27 Jun 2024
- 2023Multi-Method Self-Training: Improving Code Generation With Text, And Vice Versa20 Jul 2023
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
- 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewardscited by 33
- 2024UncertaintyRAG: Span-Level Uncertainty Enhanced Long-Context Modeling for Retrieval-Augmented Generationcited by 16
- 2024SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generationcited by 5
- 2026Transforming External Knowledge into Triplets for Enhanced Retrieval in RAG of LLMscited by 3
- 2026Transforming External Knowledge into Triplets for Enhanced Retrieval in RAG of LLMs14 Apr 2026
- 2024RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rewards17 Oct 2024
- 2024SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generation17 Oct 2024
- 2024UncertaintyRAG: Span-Level Uncertainty Enhanced Long-Context Modeling for Retrieval-Augmented Generation3 Oct 2024
- 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuning2 Oct 2023
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023A Survey of Large Language Modelscited by 2,576
- 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 878
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
12 most cited of 354 All 354 (JSON)
- 2026DAGFormer: Global Topology Prediction for Transformer Cross-Layer Connections14 Oct 2026
- 2026FunDM: Cheap & Label-Free Decision Models from Frozen Language Models12 Oct 2026
- 2026The Bell Boundary of Shared Representations12 Oct 2026
- 2026Learning Functional Subspaces for Neural Network Compression30 Sep 2026
- 2026Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection29 Sep 2026
- 2026Toward Embedding-Based Psychometrics: Structural Modeling of Assessment-Item Semantics With Contextual Scores25 Sep 2026
- 2026SupportCal: Label-Free Calibration of Post-Trained LLMs via Reference Support and Corroboration21 Sep 2026
- 2026Layer-wise Curriculum Learning for Efficient LLM Compression16 Sep 2026
- 2026Train Overcomplete, Deploy Compact: Scaling Recovery Capacity for Structured LLM Pruning7 Sep 2026
- 2026Behaviorally Effective LoRA Writes Are Sparse and Structured1 Sep 2026
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026LowRankArena: A Standardized Evaluation Platform for SVD-Based LLM Compression26 Aug 2026
12 newest of 354 All 354 (JSON)