Qwen3.6-35B-A3B Q4_K_M on Ryzen AI Max+ 395 (llama.cpp Vulkan) — inter-token latency: 15.9 ms/token

The measurement

On a Beelink GTR9 Pro — AMD Ryzen AI Max+ 395, Radeon 8060S (gfx1151), 128 GB LPDDR5X-8000 unified running llama.cpp (server, Vulkan backend), b9049 (server_fingerprint b9049-2496f9c14) with ggml-org/Qwen3.6-35B-A3B-GGUF @ baec3ebee244 (Q4_K_M), the measured inter-token latency was 15.9 ms/token (median over valid requests). The measurement was taken under the frozen interactive-assistant-v2@2026-08-02 workload; evidence level lab_repeated, 3 valid runs across 1 physical unit. The value is re-derived from the raw run records on every CI build.

Statement

Median inter-token latency (client-side decode-speed proxy) for Q4_K_M on the Vulkan backend.

Evidence

System

Beelink GTR9 Pro — AMD Ryzen AI Max+ 395, Radeon 8060S (gfx1151), 128 GB LPDDR5X-8000 unified

Runtime

llama.cpp (server, Vulkan backend), b9049 (server_fingerprint b9049-2496f9c14)

Model artifact

ggml-org/Qwen3.6-35B-A3B-GGUF @ baec3ebee244 (Q4_K_M)

Scope

interactive-assistant-v2@2026-08-02

Aggregation

median over valid requests

Evidence level

lab_repeated

Status

active

Published

August 3, 2026

Limitations

Three repeated runs on one unit, reasoning disabled.

Runs

• run-20260802-v2-nothink-a
• run-20260802-v2-nothink-a-r2
• run-20260802-v2-nothink-a-r3

Derivation

The value is re-derived from the raw run records by this query on every CI build — a published number cannot silently drift from its evidence.

catalog/claims/sql/itl-median.sql

Cited on

Pages on this site that render this number:

Cite this claim

AGmind Systems Lab. Qwen3.6-35B-A3B Q4_K_M on Ryzen AI Max+ 395 (llama.cpp Vulkan): inter-token latency — 15.9 ms/token (median over valid requests; 3 runs on 1 unit; evidence level lab_repeated; workload interactive-assistant-v2@2026-08-02). Claim strix.qwen36q4.vulkan.c1.itl-nothink. https://agmind.ai/claims/strix.qwen36q4.vulkan.c1.itl-nothink/

@misc{agmind_strix_qwen36q4_vulkan_c1_itl_nothink,
  author       = {{AGmind Systems Lab}},
  title        = {Median inter-token latency (client-side decode-speed proxy) for Q4\_K\_M on the Vulkan backend.},
  howpublished = {\url{https://agmind.ai/claims/strix.qwen36q4.vulkan.c1.itl-nothink/}},
  note         = {Claim strix.qwen36q4.vulkan.c1.itl-nothink: 15.9 ms/token; evidence level lab\_repeated; scope interactive-assistant-v2@2026-08-02},
  year         = {2026}
}

Machine-readable: /claims/strix.qwen36q4.vulkan.c1.itl-nothink.json · BibTeX · CSL-JSON · full registry · changes feed