Report

HTTP 200, empty answer: the failure mode your monitoring cannot see

A reasoning model can consume its entire token budget thinking and return a successful response with zero user-visible text. We measured how often that happens on two model families — and why TTFT dashboards look perfect while it does.

lab_repeated internal research August 14, 2026 · Funding: Self-funded internal research

There is a failure mode in local reasoning models that no availability dashboard will ever show you. The server accepts the request, streams tokens, returns HTTP 200 — and the user receives nothing, because every token the model produced was reasoning, and the budget ran out before the first character of the actual answer. We call a request that ends this way an answerless request, and we measure it as a first-class outcome: an empty answer is a failure that stays in the denominator.

How often it actually happens

On Qwen3.6-35B-A3B with reasoning enabled and a 1024-token completion budget, the share of everyday requests that came back answerless was 58.3% of requestsunit_replicated on the human-task corpus — messages, emails, explanations, plans. On the older self-referential benchmark corpus the same cell produced 75.0% of requestsrepeated. More than half of ordinary requests, silently unanswered, while the server reported success on every one of them.

A second model family reproduces the mechanism. Gemma-4-26B in its default operating mode returned 8.3% of requestsrepeated of requests answerless — a far lower rate, but nonzero, on a model whose chat template does not even expose a reasoning toggle. This is not one model’s quirk; it is what happens whenever a thinking pass and a token budget share one completion window.

Why your dashboard says everything is fine

Every conventional serving metric looks healthy while this happens:

The only metric that catches it is one almost nobody collects: answer tokens — tokens after the reasoning block closes. That is why our harness counts TTFA separately from TTFT and treats an empty answer as a failed request even when the transport succeeded.

What to do about it

Limits

Every number above has a permanent page with scope, limitations and sealed run evidence — the claim registry. The term is defined in the glossary.

Related tested configurations

Cite this report

AGmind Systems Lab (2026-08-14). HTTP 200, empty answer: the failure mode your monitoring cannot see. Evidence level: lab_repeated. https://agmind.ai/reports/answerless-http-200/
← Reports