gemma-4-26B-A4B-it Q4_0 on Ryzen AI Max+ 395 (llama.cpp Vulkan) — needle retrieval success: 95.8 % of requests

The measurement

On a Beelink GTR9 Pro — AMD Ryzen AI Max+ 395, Radeon 8060S (gfx1151), 128 GB LPDDR5X-8000 unified running llama.cpp (server, Vulkan backend), b9049 (server_fingerprint b9049-2496f9c14) with ggml-org/gemma-4-26B-A4B-it-GGUF @ bb4531cda34d (Q4_0), the measured needle retrieval success was 95.8 % of requests (share of all needle requests). The measurement was taken under the frozen long-context-v1@2026-08-03 workload; evidence level lab_repeated, 3 valid runs across 1 physical unit. The value is re-derived from the raw run records on every CI build.

Statement

Share of requests where the model retrieved the embedded fact across a 2k-32k-token ladder, EN and RU, default operating mode.

Evidence

System

Beelink GTR9 Pro — AMD Ryzen AI Max+ 395, Radeon 8060S (gfx1151), 128 GB LPDDR5X-8000 unified

Runtime

llama.cpp (server, Vulkan backend), b9049 (server_fingerprint b9049-2496f9c14)

Model artifact

ggml-org/gemma-4-26B-A4B-it-GGUF @ bb4531cda34d (Q4_0)

Scope

long-context-v1@2026-08-03

Aggregation

share of all needle requests

Evidence level

lab_repeated

Status

active

Limitations

Three repeated runs on one unit. Default operating mode of the model (reasoning emitted); disabling reasoning via the chat template was not tested for this model family.

Runs

• run-20260803-gm-lc-a
• run-20260803-gm-lc-a-r2
• run-20260803-gm-lc-a-r3

Derivation

The value is re-derived from the raw run records by this query on every CI build — a published number cannot silently drift from its evidence.

catalog/claims/sql/needle-success.sql

Cite this claim

AGmind Systems Lab. "Share of requests where the model retrieved the embedded fact across a 2k-32k-token ladder, EN and RU, default operating mode." Claim strix.gemma4.longctx.c1.needle-success (95.8 % of requests), evidence level lab_repeated, scope long-context-v1@2026-08-03. https://agmind.ai/claims/strix.gemma4.longctx.c1.needle-success/

@misc{agmind_strix_gemma4_longctx_c1_needle_success,
  author       = {{AGmind Systems Lab}},
  title        = {Share of requests where the model retrieved the embedded fact across a 2k-32k-token ladder, EN and RU, default operating mode.},
  howpublished = {\url{https://agmind.ai/claims/strix.gemma4.longctx.c1.needle-success/}},
  note         = {Claim strix.gemma4.longctx.c1.needle-success: 95.8 \% of requests; evidence level lab\_repeated; scope long-context-v1@2026-08-03},
  year         = {2026}
}

Machine-readable: /claims/strix.gemma4.longctx.c1.needle-success.json · full registry