code wiki / (root) / nx_f32_llm_bench_test.nx

nx_f32_llm_bench_test.nx

buildroot/runtime/nx_f32_llm_bench_test.nx

7122 B177 linesdepth 14pulls 65 transitivereach 0 importersview sourcekind gate/prooftopic f32
docsdependenciesstructsconstsfunctions

about

nx_f32_llm_bench_test.nx -- parked LIVE-FIRE perf harness for real Qwen2.5. Reads /tmp/nx_real_model.gguf, loads dims + weights + vocab, runs nx_f32_llm_run_v2 with a fixed prompt + 32 new tokens, captures wall-clock via sys_now_ms, and writes a TSV row to /tmp/nx_f32_llm_bench.tsv with: prompt_n / max_new / n_emitted / elapsed_ms / tokens_per_sec_milli (= tokens * 1000000 / elapsed_us). Substrate-honest scope: * This is the HARNESS, not a perf result. No claim is made about Nishi tokens/sec until this smoke runs PASS on the real file and produces measured numbers. * No comparison to llama.cpp is made here. A paired bench against llama.cpp on the same Q4_K bytes on the same hardware would be a separate brick. Per feedback-no-strawman-perf-comparisons: NO inflated claims. Smoke wrapper skips gracefully when the file is absent.

dependencies 22 imports · 0 importers

nx_syscalls.nx nx_tier.nx nx_le.nx nx_strconv.nx nx_bpe.nx nx_gguf.nx nx_gguf_load.nx nx_gguf_meta.nx nx_f32_kv_cache.nx nx_f32_lazy_weight.nx nx_f32_llm_bench_test.nx

diagram shows first 10 each side; +12 more imports, +0 more importers in the complete lists below.

imports: nx_syscalls.nxnx_tier.nxnx_le.nxnx_strconv.nxnx_bpe.nxnx_gguf.nxnx_gguf_load.nxnx_gguf_meta.nxnx_f32_kv_cache.nxnx_f32_lazy_weight.nxnx_f32_llama_block.nxnx_f32_llama_block_v4.nxnx_f32_llama_stack_v4.nxnx_f32_llama_layer_lazy_load.nxnx_f32_llm.nxnx_f32_llm_v4.nxnx_f32_llm_read_dims.nxnx_f32_bpe_load.nxnx_f32_llm_special_tokens.nxnx_f32_sampler.nxnx_f32_llm_run_v2.nxnx_f32_llm_run_v3.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main sys_mmap sys_read_file sys_openat_rd sys_lseek sys_mmap ↻ sys_read sys_close nx_gguf_parse nx_le_read_u32 nx_le_read_u64 nx_le_read_u32 ↻ _gguf_skip_value nx_le_read_u64 ↻ nx_le_read_u32 ↻ _gguf_skip_value ↻ sys_mmap ↻ nx_f32_llama_model_alloc sys_mmap ↻ nx_f32_llm_read_dims_from_ sys_mmap ↻ nx_gguf_meta_find nx_le_read_u64 ↻ nx_le_read_u32 ↻ _gmeta_bytes_equal nx_gguf_skip_value _gguf_skip_value ↻ nx_gguf_meta_read_string_l nx_le_read_u64 ↻ nx_gguf_meta_read_string_p _fld_read_arch_u32 sys_mmap ↻ _fld_concat_key nx_gguf_meta_find ↻ nx_gguf_meta_read_u32 nx_le_read_u32 ↻ _fld_read_vocab_size_from_ sys_mmap ↻ nx_gguf_find_tensor nx_gguf_tensor_at

structs

none

consts

none

functions

43func _emit_kv(fd: i64, key: *u8, key_len: nx_int, value: i64) -> i64
57func main() -> i64