mlsanityData to 14 Oct 2026

ConformalNL2LTL: Translating Natural Language Instructions into Temporal Logic Formulas with Conformal Correctness Guarantees

arXiv 2504.21022 ↗First posted 22 Apr 2025cs.CL cs.AI cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Linear Temporal Logic (LTL) is a widely used task specification language for autonomous systems. To mitigate the significant manual effort and expertise required to define LTL-encoded tasks, several methods have been proposed for translating Natural Language (NL) instructions into LTL formulas, which, however, lack correctness guarantees. To address this, we propose a new NL-to-LTL translation method, called ConformalNL2LTL that achieves user-defined translation success rates on unseen NL commands. Our method constructs LTL formulas iteratively by solving a sequence of open-vocabulary question-answering (QA) problems using large language models (LLMs). These QA tasks are handled collaboratively by a primary and an auxiliary model. The primary model answers each QA instance while quantifying uncertainty via conformal prediction; when it is insufficiently certain according to user-defined confidence thresholds, it requests assistance from the auxiliary model and, if necessary, from the user. We demonstrate theoretically and empirically that ConformalNL2LTL achieves the desired translation accuracy while minimizing user intervention.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 50 of its 79 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

50 of 79 references.

References · 50

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  4. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  5. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
  6. 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 366
  7. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
  8. 2016Least Ambiguous Set-Valued Classifiers with Bounded Error Levelscited by 272
  9. 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
  10. 2023Conformal Prediction with Large Language Models for Multi-Choice Question Answeringcited by 139
  11. 2022Safe Planning in Dynamic Environments using Conformal Predictioncited by 119
  12. 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 113
38 more
  1. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
  2. 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 89
  3. 2020Robust Validation: Confident Predictions Even When Distributions Shiftcited by 82
  4. 2019Reinforcement Learning for Temporal Logic Control Synthesis with Probabilistic Satisfaction Guaranteescited by 77
  5. 2024Explore until Confident: Efficient Exploration for Embodied Question Answeringcited by 74
  6. 2024API Is Enough: Conformal Prediction for Large Language Models Without Logit-Accesscited by 69
  7. 2023nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Modelscited by 60
  8. 2023NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Modelscited by 59
  9. 2023Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environmentscited by 53
  10. 2024On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)cited by 40
  11. 2023Data-Efficient Learning of Natural Language to Linear Temporal Logic Translators for Robot Task Specificationcited by 38
  12. 2023Collaborative Multi-Object Tracking with Conformal Uncertainty Propagationcited by 27
  13. 2024Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguitycited by 27
  14. 2018STyLuS*: A Temporal Logic Optimal Control Synthesis Algorithm for Large-Scale Multi-Robot Systemscited by 24
  15. 2023Conformal Temporal Logic Planning using Large Language Modelscited by 21
  16. 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Predictioncited by 18
  17. 2024EfficientEQA: An Efficient Approach to Open-Vocabulary Embodied Question Answeringcited by 15
  18. 2024Addressing Uncertainty in LLMs to Enhance Reliability in Generative AIcited by 15
  19. 2020Perception-Based Temporal Logic Planning in Uncertain Semantic Mapscited by 12
  20. 2019An Abstraction-Free Method for Multi-Robot Temporal Logic Optimal Control Synthesiscited by 11
  21. 2020Deep compositional robotic planners that follow natural language commandscited by 10
  22. 2024A Survey of Language-Based Communication in Roboticscited by 10
  23. 2023Data-Driven Reachability Analysis of Stochastic Dynamical Systems with Conformal Inferencecited by 9
  24. 2022Multi-robot Mission Planning in Dynamic Semantic Environmentscited by 8
  25. 20243P-LLM: Probabilistic Path Planning using Large Language Model for Autonomous Robot Navigationcited by 8
  26. 2022Model-Free Reinforcement Learning for Symbolic Automata-encoded Objectivescited by 6
  27. 2016Multi-Agent Planning under Local LTL Specifications and Event-Based Synchronizationcited by 5
  28. 2018Simultaneous Task Allocation and Planning Under Uncertaintycited by 5
  29. 2021MT* : Multi-Robot Path Planning for Temporal Logic Specificationscited by 5
  30. 2024Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Explorationcited by 5
  31. 2013Sampling-Based Temporal Logic Path Planningcited by 4
  32. 2022Time Minimization and Online Synchronization for Multi-agent Systems under Collaborative Temporal Taskscited by 4
  33. 2024Safe Decentralized Multi-Agent Control using Black-Box Predictors, Conformal Decision Policies, and Control Barrier Functionscited by 4
  34. 2023Resilient Temporal Logic Planning in the Presence of Robot Failurescited by 3
  35. 2024Perceive With Confidence: Statistical Safety Assurances for Navigation with Learning-Based Perceptioncited by 3
  36. 2021Reactive Task Allocation and Planning for Quadrupedal and Wheeled Robot Teamingcited by 1
  37. 2021Online Motion Planning with Soft Metric Interval Temporal Logic in Unknown Dynamic Environmentcited by 1
  38. 2024Continuous Execution of High-Level Collaborative Tasks for Heterogeneous Robot Teamscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 8.

11 papers.

  1. 2025Verifiable Natural Language to Linear Temporal Logic Translation: A Benchmark Dataset and Evaluation Suitecited by 4
  2. 2026From Actions to Understanding: Conformal Interpretability of Temporal Concepts in LLM Agentscited by 3
  3. 2026Fixing FOLIO and MALLS: Verified Annotations and an LLM-assisted Framework to Focus Human Relabelingcited by 1
  4. 2026Safe Embodied AI for Long-horizon Tasks: A Cross-layer Analysis of Robotic Manipulationcited by 1
  5. 2026Towards General Language-Conditioned Latent Safety Filterscited by 1
  6. 2026SCP-NL2TL: Selective Conformal Prediction with Semantic Verification for Natural Language to Temporal Logic Specificationscited by 1
  7. 2025Ask, Reason, Assist: Robot Collaboration via Natural Language and Temporal Logiccited by 0
  8. 2025CoFineLLM: Conformal Finetuning of LLMs for Language-Instructed Robot Planningcited by 0
  9. 2026Specification-Guided Synthesis of Deadlock-Free Communication Protocol Refinements with Large Language Modelscited by 0
  10. 2026Linear Temporal Logic Translation via Human-Inspired Self-Constrained Reasoning for Robot Task Specificationcited by 0
  11. 2026MENTOR: Procedural Shielding of Tool-Using LLM Agentscited by 0