nx_f32_llm_bench_test.nx
buildroot/runtime/nx_f32_llm_bench_test.nx
about
nx_f32_llm_bench_test.nx -- parked LIVE-FIRE perf harness for real Qwen2.5.
Reads /tmp/nx_real_model.gguf, loads dims + weights + vocab, runs
nx_f32_llm_run_v2 with a fixed prompt + 32 new tokens, captures
wall-clock via sys_now_ms, and writes a TSV row to
/tmp/nx_f32_llm_bench.tsv with: prompt_n / max_new / n_emitted /
elapsed_ms / tokens_per_sec_milli (= tokens * 1000000 / elapsed_us).
Substrate-honest scope:
* This is the HARNESS, not a perf result. No claim is made
about Nishi tokens/sec until this smoke runs PASS on the real
file and produces measured numbers.
* No comparison to llama.cpp is made here. A paired bench
against llama.cpp on the same Q4_K bytes on the same hardware
would be a separate brick. Per
feedback-no-strawman-perf-comparisons: NO inflated claims.
Smoke wrapper skips gracefully when the file is absent.
dependencies 22 imports · 0 importers
diagram shows first 10 each side; +12 more imports, +0 more importers in the complete lists below.
imports: nx_syscalls.nxnx_tier.nxnx_le.nxnx_strconv.nxnx_bpe.nxnx_gguf.nxnx_gguf_load.nxnx_gguf_meta.nxnx_f32_kv_cache.nxnx_f32_lazy_weight.nxnx_f32_llama_block.nxnx_f32_llama_block_v4.nxnx_f32_llama_stack_v4.nxnx_f32_llama_layer_lazy_load.nxnx_f32_llm.nxnx_f32_llm_v4.nxnx_f32_llm_read_dims.nxnx_f32_bpe_load.nxnx_f32_llm_special_tokens.nxnx_f32_sampler.nxnx_f32_llm_run_v2.nxnx_f32_llm_run_v3.nx
imported by: nobody (leaf or entry point)
call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown
structs
| none |
consts
| none |
functions
| 43 | func _emit_kv(fd: i64, key: *u8, key_len: nx_int, value: i64) -> i64 |
| 57 | func main() -> i64 |