nx_f32_llm_live_load_test.nx
buildroot/runtime/nx_f32_llm_live_load_test.nx
about
nx_f32_llm_live_load_test.nx -- LIVE-FIRE structural proof.
Loads the FULL real Qwen2.5-0.5B-Instruct Q4_K_M GGUF + runs
ONE forward pass with a 2-token prompt + verifies the resulting
logits are finite (not NaN, not inf) and non-degenerate.
Verifies that EVERY layer of the bits-up substrate works on real
production data:
sys_read_file -> 491 MB read
nx_gguf_parse -> 291 tensors + 26 metadata entries
nx_f32_llm_read_dims_from_gguf -> all 7 dims match Qwen2.5-0.5B spec
nx_f32_llm_load_weights_v4_from_gguf -> 24 layers bound (with
lazy Q4_K + eager Q5_0/Q6_K/Q8_0/F32 dispatch)
nx_f32_kv_cache_alloc -> cache for real dims
nx_f32_llm_forward_v4 -> ONE prefill pass through 24 transformer
blocks (each with RMSNorm + attn + cache + FFN-SwiGLU)
logits sanity check
Skips the full autoregressive loop (which would take ~50 min in
qemu due to 151936-column LM head matmul × 32 decode steps).
This is the "loads + runs forward" structural proof, NOT a
production tokens/sec bench.
dependencies 15 imports · 0 importers
diagram shows first 10 each side; +5 more imports, +0 more importers in the complete lists below.
imports: nx_syscalls.nxnx_tier.nxnx_gguf.nxnx_gguf_load.nxnx_gguf_meta.nxnx_f32.nxnx_f32_kv_cache.nxnx_f32_lazy_weight.nxnx_f32_llama_block.nxnx_f32_llama_block_v4.nxnx_f32_llama_stack_v4.nxnx_f32_llama_layer_lazy_load.nxnx_f32_llm.nxnx_f32_llm_v4.nxnx_f32_llm_read_dims.nx
imported by: nobody (leaf or entry point)
call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown
structs
| none |
consts
| none |
functions
| 40 | func main() -> i64 |