mlsanityData to 7 Oct 2026

Pitwall: Faithful Natural-Language Race-Strategy Briefings from a Calibrated Real-Time Monte Carlo Engine

arXiv 2607.06495 ↗First posted 7 Jul 2026cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Live sports commentary is grounded generation under a deadline: statements concern real, named athletes, the grounding state changes every few seconds, and no reference text exists at generation time. We present Pitwall, a production system that generates natural-language Formula 1 strategy briefings in English, Spanish, and Portuguese, treating faithfulness as an architectural property rather than an aspiration: every published sentence is decomposed into typed factual claims (positions, gaps, tyres, pace, overtakes, race control) and each claim is verified against the probabilistic race state that prompted it. The same verifier gates the fine-tuning data: of 3,045 model-written targets, only the 81.9% whose every claim is state-supported are retained, the rest falling back to a provably faithful template, so the generator never sees an ungrounded target. Verification is meaningful because of the grounding substrate: a vectorized Monte Carlo engine (N=2,000 per-lap race continuations) calibrated on 126 races (2018-2024) and validated on fully held-out 2025-2026 seasons (winner-in-top-3 90.3% over 155 backtests; held-out Brier 0.0745). A recurring finding spans both halves of the system: virtues trade off and must be gated separately. In simulation, calibration-optimal is not decision-optimal; in generation, fine-tuning on richer targets buys vividness that collapses into hallucination when the grounding state is sparse -- a failure a four-base replication traces to base-model instruction adherence, not scale, and that sparse-context auditing removes from the production model. End-to-end operation -- live timing to verified trilingual briefings -- was confirmed at two consecutive live Grands Prix (Austria and Britain, 2026); at Silverstone a timestamped probability trace, committed to disk before the outcome was known, locked onto the eventual winner ten laps before the flag.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 20 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

6 of 20 references.

References · 6

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  3. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  4. 2017Challenges in Data-to-Document Generationcited by 226
  5. 2020A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text Systemscited by 34
  6. 2026Precision Is Not Faithfulness: Coverage-Aware Evaluation of Grounded Generation with a Complete Oraclecited by 1

Built on by

Not cited yet.