Adaptive Constraint Propagation: Scaling Structured Inference for Large Language Models via Meta-Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Large language models increasingly require structured inference, from JSON schema enforcement to multi-lingual parsing, where outputs must satisfy complex constraints. We introduce MetaJuLS, a meta-reinforcement learning approach that learns universal constraint propagation policies applicable across languages and tasks without task-specific retraining. By formulating structured inference as adaptive constraint propagation and training a Graph Attention Network with meta-learning, MetaJuLS achieves 1.5--2.0× speedups over GPU-optimized baselines while maintaining within 0.2% accuracy of state-of-the-art parsers. On Universal Dependencies across 10 languages and LLM-constrained generation (LogicBench, GSM8K-Constrained), MetaJuLS demonstrates rapid cross-domain adaptation: a policy trained on English parsing adapts to new languages and tasks with 5--10 gradient steps (5--15 seconds) rather than requiring hours of task-specific training. Mechanistic analysis reveals the policy discovers human-like parsing strategies (easy-first) and novel non-intuitive heuristics. By reducing propagation steps in LLM deployments, MetaJuLS contributes to Green AI by directly reducing inference carbon footprint.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 68 references that are in the map. First posted on arXiv 31 Dec 2025.
Builds on
28 of 68 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
16 more
- 2023Large Language Modelscited by 780
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2017Convolutional Sequence to Sequence Learningcited by 552
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 318
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 271
- 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
- 2018Constituency Parsing with a Self-Attentive Encodercited by 199
- 2020Solving Mixed Integer Programs Using Neural Networkscited by 182
- 2020NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraintscited by 149
- 2015Minimum Risk Training for Neural Machine Translationcited by 115
- 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 111
- 2024LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Modelscited by 68
- 2025Detecting Proxy Gaming in RL and LLM Alignment via Evaluator Stress Testscited by 19
- 2020XCSP3-core: A Format for Representing Constraint Satisfaction/Optimization Problemscited by 7
- 2025Differentiable Entropy Regularization: A Complexity-Aware Approach for Neural Optimizationcited by 4
- 2025What Fundamental Structure in Reward Functions Enables Efficient Sparse-Reward Learning?cited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Reinforcement Inference: Leveraging Uncertainty for Self-Correcting Language Model Reasoning
- 2024Rational Metareasoning for Large Language Models
- 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models
- 2024MetaReflection: Learning Instructions for Language Agents using Past Reflections
- 2026Reinforcement Learning from Meta-Evaluation: Aligning Language Models Without Ground-Truth Labels
- 2025Prompt-MII: Meta-Learning Instruction Induction for LLMs
- 2025RFG: Test-Time Scaling for Diffusion Large Language Model Reasoning with Reward-Free Guidance
- 2025Learning Natural Language Constraints for Safe Reinforcement Learning of Language Agents