code wiki / (root) / nx_q4k_matmul_bench.nx

nx_q4k_matmul_bench.nx

buildroot/runtime/nx_q4k_matmul_bench.nx

723 B16 linesdepth 0pulls 0 transitivereach 1 importersview sourcekind benchtopic q4k
docsdependenciesstructsconstsfunctions

about

nx_q4k_matmul_bench.nx -- fused vs materialize-then-dot bench. Compares the two paths for a K=2048 row × col dot product (8 Q4_K super-blocks = ~3 KB of quantized weights): Path A: nx_gguf_dequant_q4_k(buf, ..., scratch_2048) + manual scalar dot product over scratch_2048 vs col_2048 Path B: nx_q4k_dot_row_col(buf, ..., col_2048, iter) fused Honest framing: numbers are on qemu-riscv64 emulation; this is OUR own two paths compared, NOT a claim against ggml/llama.cpp/CUDA. Comparison against external frameworks requires running them on the same hardware.

dependencies 0 imports · 1 importers

nx_q4k_matmul_bench.nx nx_q4k_matmul_bench_test.nx

imports: none

imported by: nx_q4k_matmul_bench_test.nx

structs

none

consts

15const NX_QMB_N_BLOCKS: i64 = 8 // K_dim / 256
16const NX_QMB_K_RUNS: i64 = 256 // bench iterations

functions

none