mlsanityData to 7 Oct 2026

Teaching Large Language Models When Not to Know: Learning Temporal Critique for Ex-Ante Reasoning

arXiv 2605.14636 ↗First posted 14 May 2026cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Large language models (LLMs) often fail to reason under temporal cutoffs: when prompted to answer from the standpoint of an earlier time, they exploit knowledge that became available only later. We study this failure through the lens of ex-ante reasoning, where a model must rely exclusively on information knowable before a cutoff. Through a systematic analysis of prompt-level interventions, we find that temporal leakage is highly sensitive to cutoff formulation and instruction placement: explicit cutoff statements outperform implicit historical framings, and prefix constraints reduce leakage more effectively than suffix constraints. These findings indicate that prompting can steer models into a temporal frame, but does not endow them with the ability to verify whether a response is temporally admissible. We further argue that supervised fine-tuning is insufficient, since ex-ante correctness is not an intrinsic property of an answer, but a relation between the answer and the cutoff. To address this gap, we propose TCFT, a Temporal Critique Fine-Tuning framework that trains models to acquire cutoff-aware temporal verification. Given a query, a cutoff, and a candidate response, TCFT teaches the model to identify post-cutoff leakage, explain temporal boundary violations, and judge temporal admissibility. Experiments with Qwen2.5-7B-Instruct and Qwen2.5-14B-Instruct show that TCFT consistently outperforms prompting and SFT baselines, reducing average leakage by 41.89 and 37.79 percentage points, respectively.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 42 of its 49 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

42 of 49 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning26 Jun
  2. 2025Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate29 Jan
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing19 May
  4. 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar

Other references · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  6. 2024Qwen2.5 Technical Reportcited by 4,713
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  9. 2023Let's Verify Step by Stepcited by 3,598
  10. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  11. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  12. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
26 more
  1. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  2. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  3. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  4. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  5. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 484
  6. 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearningcited by 274
  7. 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
  8. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
  9. 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 175
  10. 2024Free Process Rewards without Process Labelscited by 162
  11. 2024Towards Safer Large Language Models through Machine Unlearningcited by 134
  12. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
  13. 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 107
  14. 2024Critique-out-Loud Reward Modelscited by 105
  15. 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 83
  16. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
  17. 2024Machine Unlearning in Generative AI: A Surveycited by 49
  18. 2024Dated Data: Tracing Knowledge Cutoffs in Large Language Modelscited by 48
  19. 2023TRAM: Benchmarking Temporal Reasoning for Large Language Modelscited by 39
  20. 2023TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Modelscited by 39
  21. 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Modelscited by 37
  22. 2024Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?cited by 25
  23. 2024Unified Parameter-Efficient Unlearning for LLMscited by 24
  24. 2024BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysiscited by 20
  25. 2025MLLMEraser: Achieving Test-Time Unlearning in Multimodal Large Language Models through Activation Steeringcited by 9
  26. 2025ExAnte: A Benchmark for Ex-Ante Inference in Large Language Modelscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Temporal Sampling for Forgotten Reasoning in LLMs
  2. 2026TIME: Temporally Intelligent Meta-reasoning Engine for Context-Triggered Explicit Reasoning
  3. 2026When Silence Is Golden: Can LLMs Learn to Abstain in Temporal QA and Beyond?
  4. 2026TEMPO: Temporal Enforcement via Mode-Separated Policy Optimization for Trustworthy LLM Backtesting
  5. 2026Enhancing reasoning accuracy in large language models during inference time
  6. 2026Reasoning Shift: How Context Silently Shortens LLM Reasoning
  7. 2025Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models
  8. 2025NeSTR: A Neuro-Symbolic Abductive Framework for Temporal Reasoning in Large Language Models