this-that-model-1.0: A typed decision model that decides in 30 ms, for a millionth of a cent
Not on the map. Why?
Abstract (arXiv)
Software delegates more of its branches to models every year: which queue a ticket enters, whether a command is safe to run, whether a claim clears without a person. What the program needs back is not prose. It is one of n declared options and a number it can threshold. Today that costs a round trip to a frontier model -- hundreds of milliseconds, a per-token bill, and a parser -- for a question that is usually a conjunction of three clauses. this-that-model-1.0 is a 2B-parameter typed decision model. Its answer is read directly from the hidden state at a designated position and restricted to the option set the caller declared, so no text is generated, nothing can be malformed, and every question in a request is answered in the same forward pass. It decides in 30.9 ms on one laptop GPU and generates zero output tokens doing it, where a frontier API call costs 8758 ms and the hosted systems that answer these questions well spend between 21 and 212 generated tokens per question thinking first, billed for every one. It sustains 32 decisions per second on one consumer GPU and never lets the state leave the machine. On a third party's recorded cohort of 68 decision questions, on their inputs and their wording, it scores 0.941 with a Brier score of 0.042, against 0.765 and 0.133 for the hosted service Jev on the same items. One pass of our 42-family internal suite takes 32 seconds and 0.000217 USD of electricity; the most accurate hosted model we measured needs 155.2 minutes and 10.636 USD. We also report where it loses. On multi-step arithmetic, which a single forward pass cannot carry intermediate results through, it scores 0.560 against their 0.98 to 1.00, and a targeted second training round improved the five task families it was written for and transferred to none of the other 13. The model is open-sourced in https://huggingface.co/flock-io/this-that-model-1.0
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 28 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
19 of 28 references.
References · 19
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
- 2022Editing Models with Task Arithmeticcited by 1,120
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 818
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
7 more
- 2019Measuring Calibration in Deep Learningcited by 446
- 20218-bit Optimizers via Block-wise Quantizationcited by 403
- 2023Efficient Guided Generation for Large Language Modelscited by 200
- 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 197
- 2018Validating Bayesian Inference Algorithms with Simulation-Based Calibrationcited by 124
- 2026CircuitSynth: Reliable Synthetic Data Generationcited by 1
- 2026CasualSynth: Generating Structurally Sound Synthetic Datacited by 1
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Beyond Calibration: Do a Typed-Decision Model's Probabilities Obey the Probability Axioms?cited by 6
- 2026Typed Decision Models: An Early Evidence Audit and Evaluation Checklistcited by 3
- 2026Benchmarking System One decision models against trained classifiers and language models for automated decision gatescited by 1
- 2026OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System Onecited by 0
- 2026Readout Stability in Prefill-Only Decision Models:Zero-Label Prediction and Inference-Time Compute Allocationcited by 0
- 2026Can Jev be Your Q or Policy in Reinforcement Learning?cited by 0
- 2026VideoJev: System One Model for Video Understanding and Interactioncited by 0
- 2026VideoJev: System One Model for Video Understanding and Interaction13 Oct 2026
- 2026Can Jev be Your Q or Policy in Reinforcement Learning?8 Oct 2026
- 2026Readout Stability in Prefill-Only Decision Models:Zero-Label Prediction and Inference-Time Compute Allocation6 Oct 2026
- 2026OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System One30 Sep 2026
- 2026Benchmarking System One decision models against trained classifiers and language models for automated decision gates29 Sep 2026
- 2026Beyond Calibration: Do a Typed-Decision Model's Probabilities Obey the Probability Axioms?27 Sep 2026
- 2026Typed Decision Models: An Early Evidence Audit and Evaluation Checklist26 Sep 2026