TIA Run: a game driven by TIA
A three-lane road with trucks, barriers, oil slicks and glowing orbs. You do not hold the wheel: the browser sends the road ahead to TIA on the current API, asking 9 or 20 segments in one call, and the car follows the model’s answers. The six faded cars are simulations: they receive the correct answers, with only each system’s published latency simulated. The race ends after 192 segments; the table describes your run, not a ranking of AI capability. Historical measurements on 270 scenarios are documented separately in the explanation.
Loading the game...
Press “Start the run”. TIA’s car follows only the real answers that come back; no move is scripted.
Live standings · Segment 0 / 192
- TIA: real answers
- Faded cars: simulated
- Green strip: the lane TIA chose
- Rank 1: TIA, real answers, 0 segments safe and on time
- Rank 1: Jev, simulated, 0 segments safe and on time
- Rank 1: S1 open, simulated, 0 segments safe and on time
- Rank 1: Gemini, simulated, 0 segments safe and on time
- Rank 1: Luna, simulated, 0 segments safe and on time
- Rank 1: DeepSeek, simulated, 0 segments safe and on time
- Rank 1: DeBERTa, simulated, 0 segments safe and on time
TIA RunYou do not steer. Every lane change is a real answer from TIA.
How the game works
- The road moves at a fixed rate and never waits for the API. A segment with no answer yet means the car holds its lane.
- So the browser asks ahead: each call asks about K segments the car reaches only after the measured round-trip p95 plus 0.5 s. Every answer is tied to its own segment; one that lands late is dropped and counted.
- TIA Run has its own call lane (30 calls a minute per IP), and each call carries 9 or 20 segments, inside the 2,000-token limit per call. Only these two K values reached at least 95% safe lanes on the held-out test, so the game sends no other. Speed rises over 8 levels of 24 segments each, up to 0.32 s per segment; the end of level 8 is the finish line, and the page then points to the table of the race.
- Each anti-bot check gives 500 calls. When they run out the road stops (no car drives blind) and asks “Keep racing?”; press it to pass the check again and go on. Restarting costs no check while calls are left. Each IP has 2,000 calls a day, the whole site 20,000.
- On the road, the faded cars stand ahead of or behind TIA by their own count of segments safe and on time in this race, in the same order as the standings strip; that is only how it is drawn, every car covers the same distance. Each faded car takes the lane its right answer points to, and crashes or slips when its answer came late, as the numbers in the table say.
The approach follows “Real-Time Reasoning Agents in Evolving Environments” (Wen, Ye, Zhang, Yang, Zhu; arXiv 2511.04898): the world keeps moving while the model thinks, and a step with no action in time takes a default action.
What you are looking at
- No decision is faked. The car follows only TIA’s answers: no reflex, no pathfinding, no corrected answers.
- Near-equal probabilities mean the model is unsure. We print the numbers exactly as returned, with no rounding for looks and no edits.
- The road is random, but every segment always has at least one lane with no obstacle.
- The demo calls the currently served TIA build through the System One API. TIA 1.5 remains a local experimental candidate.
The race: TIA’s real answers against the published latency of other systems
TIA: real answers, the round trip measured in your browser, K segments per call. Every other car is a simulation: it is handed the right answer, one question per request, one request after another, the way JevBench v1.4.2.2 measures; each request’s delay is drawn to match the published p50 and p95. Every car sees the same road ahead (30 seconds of driving).
| Car | p50 | p95 | Measured where | Safe and on time | Late or none | Crashes | Oil slips |
|---|---|---|---|---|---|---|---|
| TIA (currently served build, real answers) | not yet | not yet | your browser, network included; historical reference p50 not yet | - | - | - | - |
| Jev 1.13.0 (TypeSafe AI) | 0.65 s | 0.72 s | public API, measured from a Hetzner server in Germany, network included | - | - | - | - |
| system-one-open (Gemma 4 E2B LoRA, L4) | 0.65 s | 0.77 s | public API, measured from a Hetzner server in Germany, network included | - | - | - | - |
| Gemini 3.1 Flash-Lite | 0.76 s | 0.88 s | public API, measured from a Hetzner server in Germany, network included | - | - | - | - |
| GPT-5.6 Luna (low reasoning effort) | 0.97 s | 1.82 s | public API, measured from a Hetzner server in Germany, network included | - | - | - | - |
| DeepSeek V4.1 Flash | 1.42 s | 4.89 s | public API, measured from a Hetzner server in Germany, network included | - | - | - | - |
| open-jev-deberta-v3-large | 1.77 s | 3.35 s | local CPU, 2 threads of a Ryzen 5 3600 | - | - | - | - |
Level by level
Segments passed safe and on time out of segments passed at each level, in this run. Bold marks the best at that level.
No level passed yet. Press “Start the run” above.
The simulated cars are not those systems’ real output: they are 100% right, and only their published latency is simulated. That favours them: they lose only where the road moves faster than one-question-at-a-time answers. The table describes your run only, not a general verdict on any system.
The game’s held-out test has 270 situations (every segment type times 3 starting lanes) and is not used for training. A historical TIA 1.4 mini run on 1 Oct 2026 selected a safe lane in 99.26% to 100% of cases at 9 segments per call (6 groupings), and 99.63% to 100% at 20. These game-task results do not establish current API quality or accuracy on other real-world tasks. Other cars simulate published JevBench latency; they do not call those systems. TIA ran historical TIA 1.3 mini on 72 public “original” JevBench items on 30 Sep 2026, scoring 29/72 (40.3%); the Benchmark page records other runs and comparison limits. See the JevBench table
Source of published numbers: JevBench v1.4.2.2, results/v1.4.2.2/jevbench-v1.4.2.2-results.json (speed.p50_s_raw, speed.p95_s_raw)