code wiki / _hdl_build / nx_nofloat_landing_gate.nx
nx_nofloat_landing_gate.nx
buildroot/runtime/_hdl_build/nx_nofloat_landing_gate.nx
about
nx_nofloat_landing_gate.nx -- THE MEASURED LANDING (roadmap R4 increment; finding 7 = perplexity is the
standard cheap held-out metric, nfs_perplexity.raw). A no-float LM is "landed" on a domain when its
HELD-OUT per-token cross-entropy reaches the domain's INFORMATION FLOOR (the irreducible entropy) and is far
below the uniform baseline. Domain = the grammar [ARTICLE,NOUN,VERB] (fresh-random members), whose intrinsic
per-token entropy = avg(ln2, ln3, ln3) ~= 0.964 nats (perplexity ~= 2.62): an article position has 2 equally
likely members, noun/verb positions have 3 -- the members are RANDOM so NO model can beat that floor; the
uniform-over-vocab baseline is ln(8) = 2.079 nats (perplexity 8). We train on fresh-random streams (so the
model learns the GRAMMAR, not sequences) and measure CE on NEVER-SEEN streams.
T1 held-out CE << uniform ln(8) (the model beat the baseline = it learned).
T2 held-out CE ~= the information floor (near-OPTIMAL = landed: it reached the domain's entropy limit).
Pure integer Q16. Sovereign: nx_nofloat_autograd + nx_syscalls. expect_exit: 0
dependencies 3 imports · 0 importers
imports: nx_nofloat_autograd.nxnx_syscalls.nxnx_gate_emit_lib.nx
imported by: nobody (leaf or entry point)
call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown
structs
| none |
consts
| 15 | const Q16: i64 = 65536 |
| 17 | const UNIFORM_MNAT: i64 = 2079 |
| 18 | const FLOOR_MNAT: i64 = 964 |
functions
| 21 | func dini(a: *i64, n: i64, sd: i64) -> i64 { var i: i64=0; while i<n { a[i]=(((i*7+sd*13+1)%11)-5)*13107; i=i+1 } return 0 } called by 1: main |
| 22 | func lcg(st: *i64) -> i64 { st[0]=(st[0]*1103515245 + 12345) & 2147483647; return (st[0] >> 15) } called by 1: make_stream |
| 23 | func make_stream(S: *i64, tgt: *i64, P: i64, st: *i64) -> i64 |
| 29 | func clm_fwd(tape: *i64, vals: *i64, st: *i64, W: *i64, ids: *i64, tgt: *i64, T: i64, dm: i64, V: i64, scale: i64, leaves: *i64) -> i64 called by 2: do_traineval_ce calls 10: nfa_leafnfa_embednfa_rmsnorm_rowsnfa_matmulnfa_ropenfa_matmul_nt+4 |
| 57 | func step_all(tape: *i64, grads: *i64, W: *i64, WN: *i64, leaves: *i64, nW: i64, lr: i64, clip: i64, gb: *i64) -> i64 |
| 62 | func do_train(tape: *i64, vals: *i64, grads: *i64, st: *i64, W: *i64, WN: *i64, S: *i64, tgt: *i64, P: i64, dm: i64, V: i64, scale: i64, leaves: *i64, gb: *i64, steps: i64, sdat: *i64) -> i64 |
| 68 | func eval_ce(tape: *i64, vals: *i64, st: *i64, W: *i64, S: *i64, tgt: *i64, P: i64, dm: i64, V: i64, scale: i64, leaves: *i64, N: i64, sdat: *i64) -> i64 |
| 80 | func main() -> i64 |