code wiki / (root) / nx_f32_bpe_load_test.nx

nx_f32_bpe_load_test.nx

buildroot/runtime/nx_f32_bpe_load_test.nx

4909 B124 linesdepth 8pulls 14 transitivereach 0 importersview sourcekind gate/prooftopic f32
docsdependenciesstructsconstsfunctions

about

nx_f32_bpe_load_test.nx -- smoke for nx_f32_bpe_load.nx. Builds a synthetic GGUF with tokenizer.ggml.tokens and tokenizer.ggml.merges arrays. Verifies the loader populates the vocab + merge rules.

dependencies 9 imports · 0 importers

nx_syscalls.nx nx_tier.nx nx_le.nx nx_intern.nx nx_bpe.nx nx_gguf.nx nx_gguf_load.nx nx_gguf_meta.nx nx_f32_bpe_load.nx nx_f32_bpe_load_test.nx

imports: nx_syscalls.nxnx_tier.nxnx_le.nxnx_intern.nxnx_bpe.nxnx_gguf.nxnx_gguf_load.nxnx_gguf_meta.nxnx_f32_bpe_load.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main nx_fbl_verdict_is_valid sys_mmap nx_le_write_u32 nx_le_write_u64 nx_le_write_u32 ↻ _write_str_at nx_le_write_u64 ↻ nx_gguf_parse nx_le_read_u32 nx_le_read_u64 nx_le_read_u32 ↻ _gguf_skip_value nx_le_read_u64 ↻ nx_le_read_u32 ↻ _gguf_skip_value ↻ sys_mmap ↻ nx_bpe_vocab_new sys_mmap ↻ nx_intern_new nx_intern_next_pow2 nx_hash_new nx_f32_bpe_load_from_gguf _fbl_load_tokens sys_mmap ↻ nx_gguf_meta_find nx_le_read_u64 ↻ nx_le_read_u32 ↻ _gmeta_bytes_equal nx_gguf_skip_value _gguf_skip_value ↻ nx_gguf_meta_array_inner_t nx_le_read_u32 ↻ nx_gguf_meta_array_count nx_le_read_u64 ↻ nx_gguf_meta_array_first_e nx_le_read_u64 ↻ nx_bpe_add_token nx_intern_get nx_hash_fnv1a_bytes

structs

none

consts

none

functions

17func _write_str_at(buf: *u8, p_in: i64, s: *u8, s_len: i64) -> i64
called by 1: main calls 1: nx_le_write_u64
25func main() -> i64