Research

Jomoq-1 everywhere: frontier-grade chat in 1.4 s on 21× fewer tokens

Jomoq Research · 21 August 2026 · judged benchmarks, chat n=7 tasks × 4 configurations, builder n=24 tasks

Two weeks ago we shipped Jomoq-1 in the builder: a verified fast pass that drafts most code edits deterministically-checked in under a second, escalating to a frontier model only when verification fails. This post reports what happened when we applied the same architecture to chat, and the finalized numbers for both surfaces.

The design premise is unchanged: most turns don't need a frontier model: they need the right context assembled fast. In chat that means three things: classify the turn before any model call; fetch structured data (FRED economic series, search results) in parallel rather than letting the model discover it over sequential tool round-trips; and send mode-sized scaffolding: a research turn gets 4 tool schemas and a 600-token prompt, not the 21 KB monolith (9.1 KB system prompt + 23 tool schemas ≈ 4,000 tokens) that a conventional harness re-sends on every loop iteration.

Chat results

Seven tasks, comprising three live economic-data questions (multi-series FRED), two live-web research questions, and two conversational, run through four configurations. Three of them use what we call the conventional harness: Jomoq chat's own pre-Jomoq-1 pipeline (the full 9.1 KB system prompt and all 23 tool schemas on every loop iteration, sequential tool round-trips). In other words, we benchmark the new architecture against our own previous product, with three different models inside it. Every configuration executes real tools (live FRED and Tavily calls) and every reply is judged by Claude Sonnet 5 against ground truth fetched independently at judging time.

ConfigurationJudged passAvg score /10Median latencyMedian tokens / turn
Jomoq-1 chat (intent-routed, parallel prefetch, slim scaffolding)5 / 78.01.4 s850
Same engine, conventional harness (gpt-oss-120b, full scaffolding loop)3 / 75.02.8 s9,090
Nemotron 3.5 Lightning (free pool), conventional harness3 / 76.33.2 s14,301
Claude Sonnet 5, conventional harness6 / 77.18.0 s18,254
Jomoq-1 chat 850 Nemotron 3.5 (free) 14,301 Same engine, pre-Jomoq harness 9,090 Sonnet 5, pre-Jomoq harness 18,254
Median tokens per judged chat turn (input + output, all loop iterations summed). Jomoq-1 uses 10.7× fewer tokens than the same engine in the conventional harness and 21× fewer than the frontier configuration. Latency and token totals include live tool execution for every configuration.
Jomoq-1 chat 1.4 s · score 8.0 · pass 5/7 Nemotron 3.5 (free) 3.2 s · score 6.3 · pass 3/7 Same engine, pre-Jomoq harness 2.8 s · score 5.0 · pass 3/7 Sonnet 5, pre-Jomoq harness 8.0 s · score 7.1 · pass 6/7
Median wall-clock per turn including live tool execution, with judged scores and pass rates. The frontier configuration passes one more task (6/7), at 5.6× the latency and 21× the tokens. Jomoq-1 holds the highest average quality score while staying in the fast tier.

The headline case is the three-series question: "Pull the latest CPI, core CPI, and the Fed funds rate from FRED and compare each to a year ago." A conventional harness turns this into sequential tool round-trips; the frontier configuration spent 50 seconds and 62K tokens on it (and 159 seconds on the single-series Treasury question, where it spiralled through repeated searches). Jomoq-1 classifies the intent client-side, fetches all three series from FRED in parallel, and makes exactly one model call with the data attached: 1.4 s, 2,228 tokens, judged 10/10 against independently fetched ground truth, as were both other economic-data tasks.

Builder results (finalized)

The builder numbers below consolidate the full 24-task regression suite (text edits, styles, elements, refactors, generative sections, understanding-required edits on 1.3–2.1K-line files), judged by Claude Opus 5, plus live dogfooding traces on a real 2.1K-line project.

MetricResult
Judged task success (24-task suite)24/24 (one transient network error, clean on retry)
Fast-lane share (draft or verified full write, no frontier call)92%
Draft latency, small editsp50 ≈ 0.3–0.7 s
Cost vs. classic full-rewrite baseline (matched tasks)17.7× cheaper (up to 43× on large files)
False ships (drafts that verified but were judged broken)0 (cross-cutting selector renames escalate deterministically)
Brand rename, 3-file project 15 s 0.71 s Coordinated edit, 2.1K-line file 64 s 1.4 s Full 3-file app build ~90 s 2.0 s
Live traces on real projects, before (grey) vs. after (green): same requests, same files. The 2-second build was judged by Claude Opus 5: fulfills the request, runs without console errors, shippable as a first draft the user iterates on.

How this compares to the industry

The closest published work on dual-model inference reports a 1.25× realistic end-to-end speedup from transferring KV-cache state between a small and a large model, with 61–82% output agreement, restricted to open-weight model pairs. We took the opposite bet: operate at the task level, not the tensor level. When the fast lane ships, fidelity is 100% by construction: the output either passes deterministic verification or the turn escalates with full context. That trade is what turns 1.25× into the multiples above: 21× on brand renames, 45× on coordinated large-file edits, ~45× on app builds, 5.6× on frontier-versus-Jomoq chat latency (35× on the three-series economics question), because the win compounds: fewer model calls × smaller calls × a faster engine.

Against conventional assistant harnesses, the token economics compound the same way. The 21 KB scaffolding a typical tool-calling loop re-sends every iteration is invisible in a demo and dominant at scale; mode-sized context plus parallel prefetch is why a judged Jomoq-1 chat turn costs a median 850 tokens while the same engine in the pre-Jomoq harness costs 9,090: same model, same tools, 10.7× difference from architecture alone.

Method & honesty notes

Jomoq-1 chat lanes ship behind the same verification philosophy as the builder: structured answers cite the series they were computed from, research turns carry their sources, and four independently-verified recovery layers keep free-tier models from ever ending a turn with leaked tool syntax. Try it: pick Jomoq 1 in the chat model menu.