SerenAI: State-transition system inspired by text-based world AI models
Not on the map. Why?
Abstract (arXiv)
Although professional workflows leverage large language models widely, the interpretation for auditing unconstrained free-text generation is usually intractable if such generation demands legal, operational or financial workflow. We hereby demonstrate a text based system called SerenAI - inspired by world-models, it is a state transition system that outputs verifiable predictions rather than merely text: Provided with a description of the environment, state, and actions, the generated output contains 4 items: causal deltas that causally effect the given state, a next state that can logically follow from the given state and action, a validity reward, and a termination signal. For the released proto-model, we employ 2 steps of adaptation training, namely parameter efficient fine-tuning followed by verifier based RL over 50,000 exampled cause and effects in 12 environments spanning 10 reasoning domains. Compared to an initial internal evaluation of an 8B open-weight baseline, SerenAI increased JSON validity from 85.0% to 93.2%, schema validity from 55.0% to 84.0%, exact structured-output match from 0.0% to 41.5%, causal-delta exact match from 0.0% to 41.5%, resulting-state exact match from 0.0% to 42.0%, reward exact match from 1.0% to 80.5%, and termination exact match from 38.0% to 81.5%. These support the narrower claim that verifier-compatible adaptation can improve structured transition prediction. They do not yet establish legal-grade reliability. Accordingly, the paper also specifies a validation protocol for evidence-grounded legal workflows, calibration, human oversight, and sovereign on-premise deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 22 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
15 of 22 references.
References · 15
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2020Extracting Training Data from Large Language Modelscited by 2,189
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2018World Modelscited by 1,513
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2018Model Cards for Model Reportingcited by 1,080
- 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 411
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LOGIGEN: Logic-Driven Generation of Verifiable Agentic Tasks
- 2026Towards Computational Provenance: Carrying Causal-State Evidence in Generated Text
- 2024The Fusion of Large Language Models and Formal Methods for Trustworthy AI Agents: A Roadmap
- 2025Tracking World States with Language Models: State-Based Evaluation Using Chess
- 2026State of Thought Enables Endogenous Reasoning
- 2026HyperWorld: Hypergraph-Structured State Serialization Improves Learned Textual World Models
- 2026SPARK: Susceptibility-Guided Profiling and Steering of Latent Reasoning States in Large Language Models
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generation