code wiki / _hdl_build / nx_tok_fold_gate.nx

nx_tok_fold_gate.nx

buildroot/runtime/_hdl_build/nx_tok_fold_gate.nx

9084 B182 linesdepth 3pulls 3 transitivereach 0 importersview sourcekind gate/prooftopic tok
docsdependenciesstructsconstsfunctions

about

nx_tok_fold_gate.nx -- KATs for the accent-folding UTF-8 tokenizer (the Unicode rung): Latin diacritics fold to ASCII base letters on BOTH tokenize sides, unfoldable codepoints separate cleanly (whole sequence consumed -- continuation bytes never leak into tokens), ASCII behavior is byte-identical to before, and the STORE-LEVEL proof: an indexed doc containing "Kyōka" is found by ss_term("kyoka") and the quoted phrase evaluator (fold-consistent positions). license_tier: ORIGINAL

dependencies 1 imports · 0 importers

nx_seg_store.nx nx_tok_fold_gate.nx

imports: nx_seg_store.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main gf_puts gf_toks ss_tok_table gf_len ss_tok_next2 ss_u8cp ss_fold_cp ss_fold_word_cp ss_is_cjk gf_eq gf_check gf_puts ↻ ss_begin ss_begin_cap sys_mmap ss_add ss_add2 ss_w32 ss_len gf_len ↻ ss_commit ss_segid_ok sys_mmap ↻ ss_cat ss_catn sys_mmap ↻ sys_write ss_write_seg ss_segid_ok ↻ sys_mmap ↻ ss_cat ↻ ss_catn ↻ sys_write ↻ ss_segname ss_cat ↻ ss_catn ↻ ss_writefile sys_openat_wr sys_write ↻

structs

none

consts

none

functions

8func gf_puts(s: *u8) -> i64 { var n: i64 = 0; while s[n] != (0 as u8) { n = n + 1 } sys_write(1, s, n); return 0 }
called by 2: gf_checkmain
9func gf_num(v: i64) -> i64
called by 1: main
18func gf_len(s: *u8) -> i64 { var n: i64 = 0; while s[n] != (0 as u8) { n = n + 1 } return n }
called by 2: gf_toksmain
19func gf_check(name: *u8, cond: i64, pass: *i64, total: *i64) -> i64
called by 1: main calls 1: gf_puts
26func gf_toks(s: *u8, out: *u8) -> i64
called by 1: main calls 3: ss_tok_tablegf_lenss_tok_next2
48func gf_eq(a: *u8, b: *u8) -> i64
called by 1: main
59func main() -> i64
calls 12: gf_putsgf_toksgf_eqgf_checkss_beginss_add+6