Teaching Large Language Models When Not to Know: Learning Temporal Critique for Ex-Ante Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Large language models (LLMs) often fail to reason under temporal cutoffs: when prompted to answer from the standpoint of an earlier time, they exploit knowledge that became available only later. We study this failure through the lens of ex-ante reasoning, where a model must rely exclusively on information knowable before a cutoff. Through a systematic analysis of prompt-level interventions, we find that temporal leakage is highly sensitive to cutoff formulation and instruction placement: explicit cutoff statements outperform implicit historical framings, and prefix constraints reduce leakage more effectively than suffix constraints. These findings indicate that prompting can steer models into a temporal frame, but does not endow them with the ability to verify whether a response is temporally admissible. We further argue that supervised fine-tuning is insufficient, since ex-ante correctness is not an intrinsic property of an answer, but a relation between the answer and the cutoff. To address this gap, we propose TCFT, a Temporal Critique Fine-Tuning framework that trains models to acquire cutoff-aware temporal verification. Given a query, a cutoff, and a candidate response, TCFT teaches the model to identify post-cutoff leakage, explain temporal boundary violations, and judge temporal admissibility. Experiments with Qwen2.5-7B-Instruct and Qwen2.5-14B-Instruct show that TCFT consistently outperforms prompting and SFT baselines, reducing average leakage by 41.89 and 37.79 percentage points, respectively.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 42 of its 49 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
42 of 49 references.
Closest ancestors · 4
Same direction, newest first
- 2025Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning26 Jun
- 2025Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate29 Jan
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing19 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 38
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023Let's Verify Step by Stepcited by 3,598
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
26 more
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 484
- 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearningcited by 274
- 2023In-Context Unlearning: Language Models as Few Shot Unlearnerscited by 214
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2023Time Travel in LLMs: Tracing Data Contamination in Large Language Modelscited by 175
- 2024Free Process Rewards without Process Labelscited by 162
- 2024Towards Safer Large Language Models through Machine Unlearningcited by 134
- 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
- 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 107
- 2024Critique-out-Loud Reward Modelscited by 105
- 2024Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoningcited by 83
- 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
- 2024Machine Unlearning in Generative AI: A Surveycited by 49
- 2024Dated Data: Tracing Knowledge Cutoffs in Large Language Modelscited by 48
- 2023TRAM: Benchmarking Temporal Reasoning for Large Language Modelscited by 39
- 2023TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Modelscited by 39
- 2023Towards Benchmarking and Improving the Temporal Reasoning Capability of Large Language Modelscited by 37
- 2024Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?cited by 25
- 2024Unified Parameter-Efficient Unlearning for LLMscited by 24
- 2024BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysiscited by 20
- 2025MLLMEraser: Achieving Test-Time Unlearning in Multimodal Large Language Models through Activation Steeringcited by 9
- 2025ExAnte: A Benchmark for Ex-Ante Inference in Large Language Modelscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Temporal Sampling for Forgotten Reasoning in LLMs
- 2026TIME: Temporally Intelligent Meta-reasoning Engine for Context-Triggered Explicit Reasoning
- 2026When Silence Is Golden: Can LLMs Learn to Abstain in Temporal QA and Beyond?
- 2026TEMPO: Temporal Enforcement via Mode-Separated Policy Optimization for Trustworthy LLM Backtesting
- 2026Enhancing reasoning accuracy in large language models during inference time
- 2026Reasoning Shift: How Context Silently Shortens LLM Reasoning
- 2025Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models
- 2025NeSTR: A Neuro-Symbolic Abductive Framework for Temporal Reasoning in Large Language Models