Claim

gemma-4-26B-A4B-it Q4_0 on Ryzen AI Max+ 395 (llama.cpp Vulkan) — answerless (empty) responses in default mode: 8.3 % of requests

active lab_repeated strix.gemma4.interactive2.c1.answerless-default

8.3% of requests

The measurement

On a Beelink GTR9 Pro — AMD Ryzen AI Max+ 395, Radeon 8060S (gfx1151), 128 GB LPDDR5X-8000 unified running llama.cpp (server, Vulkan backend), b9049 (server_fingerprint b9049-2496f9c14) with ggml-org/gemma-4-26B-A4B-it-GGUF @ bb4531cda34d (Q4_0), the measured answerless (empty) responses in default mode was 8.3 % of requests (share of all issued requests). The measurement was taken under the frozen interactive-assistant-v2@2026-08-02 workload; evidence level lab_repeated, 3 valid runs across 1 physical unit. The value is re-derived from the raw run records on every CI build.

Statement

In its default operating mode at a 1024-token budget, this share of everyday requests returned HTTP 200 with an empty answer: the reasoning pass consumed the entire budget. A second model family reproduces the failure mode.

Evidence

System
Beelink GTR9 Pro — AMD Ryzen AI Max+ 395, Radeon 8060S (gfx1151), 128 GB LPDDR5X-8000 unified
Runtime
llama.cpp (server, Vulkan backend), b9049 (server_fingerprint b9049-2496f9c14)
Model artifact
ggml-org/gemma-4-26B-A4B-it-GGUF @ bb4531cda34d (Q4_0)
Scope
interactive-assistant-v2@2026-08-02
Aggregation
share of all issued requests
Evidence level
lab_repeated
Status
active
Limitations
Three repeated runs on one unit. Default operating mode of the model (reasoning emitted); disabling reasoning via the chat template was not tested for this model family.
Runs

Derivation

The value is re-derived from the raw run records by this query on every CI build — a published number cannot silently drift from its evidence.

catalog/claims/sql/answerless-rate-1k.sql

Cite this claim

AGmind Systems Lab. "In its default operating mode at a 1024-token budget, this share of everyday requests returned HTTP 200 with an empty answer: the reasoning pass consumed the entire budget. A second model family reproduces the failure mode." Claim strix.gemma4.interactive2.c1.answerless-default (8.3 % of requests), evidence level lab_repeated, scope interactive-assistant-v2@2026-08-02. https://agmind.ai/claims/strix.gemma4.interactive2.c1.answerless-default/
@misc{agmind_strix_gemma4_interactive2_c1_answerless_default,
  author       = {{AGmind Systems Lab}},
  title        = {In its default operating mode at a 1024-token budget, this share of everyday requests returned HTTP 200 with an empty answer: the reasoning pass consumed the entire budget. A second model family reproduces the failure mode.},
  howpublished = {\url{https://agmind.ai/claims/strix.gemma4.interactive2.c1.answerless-default/}},
  note         = {Claim strix.gemma4.interactive2.c1.answerless-default: 8.3 \% of requests; evidence level lab\_repeated; scope interactive-assistant-v2@2026-08-02},
  year         = {2026}
}

Machine-readable: /claims/strix.gemma4.interactive2.c1.answerless-default.json · full registry

Own comparable hardware? This claim can be reproduced: /reproduce/

Corrections to published results are logged publicly: errata

← All claims