mlsanityData to 14 Oct 2026

Adaptive Constraint Propagation: Scaling Structured Inference for Large Language Models via Meta-Reinforcement Learning

arXiv 2601.00095 ↗First posted 31 Dec 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models increasingly require structured inference, from JSON schema enforcement to multi-lingual parsing, where outputs must satisfy complex constraints. We introduce MetaJuLS, a meta-reinforcement learning approach that learns universal constraint propagation policies applicable across languages and tasks without task-specific retraining. By formulating structured inference as adaptive constraint propagation and training a Graph Attention Network with meta-learning, MetaJuLS achieves 1.5--2.0× speedups over GPU-optimized baselines while maintaining within 0.2% accuracy of state-of-the-art parsers. On Universal Dependencies across 10 languages and LLM-constrained generation (LogicBench, GSM8K-Constrained), MetaJuLS demonstrates rapid cross-domain adaptation: a policy trained on English parsing adapts to new languages and tasks with 5--10 gradient steps (5--15 seconds) rather than requiring hours of task-specific training. Mechanistic analysis reveals the policy discovers human-like parsing strategies (easy-first) and novel non-intuitive heuristics. By reducing propagation steps in LLM deployments, MetaJuLS contributes to Green AI by directly reducing inference carbon footprint.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 68 references that are in the map. First posted on arXiv 31 Dec 2025.

Builds on

28 of 68 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  6. 2017Graph Attention Networkscited by 8,923
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  9. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  10. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  11. 2015Continuous control with deep reinforcement learningcited by 3,407
  12. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
16 more
  1. 2023Large Language Modelscited by 780
  2. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
  3. 2017Convolutional Sequence to Sequence Learningcited by 552
  4. 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 318
  5. 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 271
  6. 2021Combinatorial optimization and reasoning with graph neural networkscited by 268
  7. 2018Constituency Parsing with a Self-Attentive Encodercited by 199
  8. 2020Solving Mixed Integer Programs Using Neural Networkscited by 182
  9. 2020NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraintscited by 149
  10. 2015Minimum Risk Training for Neural Machine Translationcited by 115
  11. 2015Yara Parser: A Fast and Accurate Dependency Parsercited by 111
  12. 2024LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Modelscited by 68
  13. 2025Detecting Proxy Gaming in RL and LLM Alignment via Evaluator Stress Testscited by 19
  14. 2020XCSP3-core: A Format for Representing Constraint Satisfaction/Optimization Problemscited by 7
  15. 2025Differentiable Entropy Regularization: A Complexity-Aware Approach for Neural Optimizationcited by 4
  16. 2025What Fundamental Structure in Reward Functions Enables Efficient Sparse-Reward Learning?cited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reinforcement Inference: Leveraging Uncertainty for Self-Correcting Language Model Reasoning
  2. 2024Rational Metareasoning for Large Language Models
  3. 2025Meta-Reasoner: Dynamic Guidance for Optimized Inference-time Reasoning in Large Language Models
  4. 2024MetaReflection: Learning Instructions for Language Agents using Past Reflections
  5. 2026Reinforcement Learning from Meta-Evaluation: Aligning Language Models Without Ground-Truth Labels
  6. 2025Prompt-MII: Meta-Learning Instruction Induction for LLMs
  7. 2025RFG: Test-Time Scaling for Diffusion Large Language Model Reasoning with Reward-Free Guidance
  8. 2025Learning Natural Language Constraints for Safe Reinforcement Learning of Language Agents