code wiki / nofloat

topic: nofloat

126 modules sharing the nofloat name family (derived from the tree's prefix discipline).

Integer-only machine learning: inference (and the training experiments) expressed without floating point at all — quantized arithmetic end to end, in keeping with the pure-integer core. This is the research track toward models the ecosystem can run and eventually train entirely on its own terms; the f32 family is the pragmatic counterpart for imported weights.

narrated overview -- maintained by the narration lane, module links verified against this wiki.

moduledescriptionlinesfuncs
nx_nofloat_adamw32_gate.nxthe REAL win from the R4 scale-up work: a numerically STABLE fixed-point Adam.784
nx_nofloat_adamw_gate.nxHARD-EVIDENCE gate for the Q16 AdamW optimizer (nfa_adamw), with a MEASURED1304
nx_nofloat_adversary.nxCAP-NF-ADVERSARY: a DURABLE, sovereign adversarial reviewer. Nishi OWNS adversarial1419
nx_nofloat_arch.nxARCH-CONFIGURABLE inference: read a model's dims from GGUF METADATA instead of745
nx_nofloat_arch_config_gate.nxproves ARCH-CONFIGURABLE inference: read the model's dims from GGUF964
nx_nofloat_arch_moe_gate.nxgates the arch-config debt eaten 2026-07-15: EXACT attention scale +1236
nx_nofloat_attention_gate.nxASSEMBLE the trio into one DETERMINISTIC transformer attention layer.16411
nx_nofloat_attn.nxSOVEREIGN NO-FLOAT ATTENTION (the transformer HEART), integer Q16, deterministic. The hard807
nx_nofloat_attn_gate.nxHARD-EVIDENCE gate for the ATTENTION-CORE backward (CAP-NF-ATTN-CORE): a single-head24413
nx_nofloat_audit.nxCAP-NF-AUDIT (REBUILT after a 2nd adversarial review called the v1 tautological).749
nx_nofloat_autograd.nxNO-FLOAT (integer Q16 fixed-point) reverse-mode TENSOR autograd: the genuine77438
nx_nofloat_autograd_ddp_gate.nxDEEPER R4->LLM: bit-reproducible data-parallel training driven by the1708
nx_nofloat_autograd_gate.nxHARD-EVIDENCE gate for the NO-FLOAT (integer Q16) general autograd22112
nx_nofloat_batched_forward_gate.nxTHE DECISIVE SPECULATIVE-DECODING FOUNDATION EXPERIMENT.1406
nx_nofloat_bench.nxCAP-NF-BENCH: HONEST measured benchmark of our no-float Q16 stack vs the Unsloth-class9711
nx_nofloat_block_gate.nxHARD-EVIDENCE gate for a COMPLETE pre-norm TRANSFORMER BLOCK backprop + train,29511
nx_nofloat_blockfloat_gate.nxBLOCK-FLOAT quant rung: per-block power-of-2-scaled integer = MXFP8's1187
nx_nofloat_blockfloat_gemm_gate.nxBLOCK-FLOAT weights through the no-float GEMM: the format earns its place1419
nx_nofloat_blockfloat_layer_gate.nxBLOCK-FLOAT weights through a real LINEAR LAYER (W.x + bias -> ReLU),14710
nx_nofloat_bpe_gate.nxR2 (efficiency) from the sovereign-researcher roadmap843
nx_nofloat_bpe_lm_gate.nxCAPSTONE: the WHOLE sovereign efficient text pipeline wired END-TO-END, pure1498
nx_nofloat_census.nxCAP-NF-CENSUS: a LIVING, liar-killed, negative-controlled census of our S-class875
nx_nofloat_corpus_gate.nxHARD-EVIDENCE: a CHARACTER-LEVEL language model trains on REAL TEXT, pure2108
nx_nofloat_deepstack_gate.nxHARD-EVIDENCE gate that the no-float transformer scales in DEPTH: a21510
nx_nofloat_distill_gate.nxR3 (cheap quality) from the sovereign-researcher roadmap914
nx_nofloat_exceed_gate.nxthe UNIQUE Nishi exceed axis: NO-FLOAT determinism.683
nx_nofloat_gemm.nxcanonical sovereign INTEGER SIMD GEMM (vpmaddwd / __i16x16_madd):414
nx_nofloat_gemm_gate.nxthe NO-FLOAT compute lever: integer SIMD GEMM (vpmaddwd), the deterministic1033
nx_nofloat_generalize_gate.nxHELD-OUT RULE GENERALIZATION in pure integer Q16 (CAP-NF-GENERALIZE). The1159
nx_nofloat_generate_gate.nxAUTOREGRESSIVE TEXT GENERATION from a trained no-float LM, integer Q16888
nx_nofloat_grammar_gate.nxCAP-NF-GRAMMAR: the AFFORDABLE "landing" step the sovereign researcher15011
nx_nofloat_hw_research_fetch.nxSOVEREIGN researcher: GROUND the HARDWARE-RUNG-UP exceed in REAL fetched715
nx_nofloat_hwladder.nxCAP-NF-HWLADDER: the HARDWARE-RUNG-UP ladder, silicon -> AI, each rung grounded on a625
nx_nofloat_incontext_gate.nxIN-CONTEXT COPYING (CAP-NF-INCONTEXT): the basis of in-context learning.1368
nx_nofloat_induction_gate.nxCONTENT-BASED INDUCTION (CAP-NF-INDUCTION), REBUILT after the 3rd adversarial1346
nx_nofloat_k3block.nxLOGICALLY-INTEGRATED K3-style transformer BLOCK in no-float (operator 2026-07-19684
nx_nofloat_k3block_gate.nxgate: the K3 primitives LOGICALLY INTEGRATE into one deterministic block.752
nx_nofloat_k3interleave.nxTHE K3 BLOCK STRUCTURE, ASSEMBLED (operator 2026-07-19 "logically integrated,902
nx_nofloat_k3interleave_gate.nxgate: the 3:1 KDA:MLA interleaved K3 block structure, assembled from the1232
nx_nofloat_k3stack.nxMULTI-LAYER K3 stack with ATTENTION RESIDUALS in no-float (operator 2026-07-19975
nx_nofloat_k3stack_gate.nxgate: N-layer K3 stack with Attention Residuals, deterministic AT DEPTH.812
nx_nofloat_kda.nxKIMI DELTA ATTENTION (KDA) in sovereign no-float = the K3 namesake attention624
nx_nofloat_kda_gate.nxgate: Kimi Delta Attention, the K3-distinctive behaviors (not just "it runs").1472
nx_nofloat_kvcache_gate.nxCAP-NF-KVCACHE: a KV-CACHE for O(T) autoregressive decode (vs O(T^2)14512
nx_nofloat_kvcache_int8_gate.nxCAP-NF-KVCACHE-INT8: a QUANTIZED KV-cache (store cached K/V at int8 =12915
nx_nofloat_ladder.nxCAP-NF-LADDER: the CONSOLIDATION capstone. Grounds the whole no-float DeepMind ladder694
nx_nofloat_landing_gate.nxTHE MEASURED LANDING (roadmap R4 increment; finding 7 = perplexity is the1198
nx_nofloat_layernorm_gate.nxthe THIRD no-float transformer primitive: integer rsqrt -> LayerNorm.1017
nx_nofloat_linattn.nxSOVEREIGN no-float LINEAR ATTENTION recurrent kernel = the foundation of Kimi524
nx_nofloat_linattn_gate.nxgate for the no-float linear-attention recurrent kernel (KDA foundation).1002
nx_nofloat_llm.nxCANONICAL sovereign no-float LLM library (ONE source of truth; no copy-paste debt).134080
nx_nofloat_lm_gate.nxTHE CAPSTONE: a tiny TRANSFORMER LANGUAGE MODEL trains END-TO-END on next-token29512
nx_nofloat_mla.nxMLA (Multi-head Latent Attention, DeepSeek's marquee KV-compression) in no-float1295
nx_nofloat_mla_gate.nxMLA no-float SERVE (the census's #1 remaining July-2026 gap, 2026-07-15).1394
nx_nofloat_mlp.nxSOVEREIGN NO-FLOAT MLP + INTEGER BACKPROP (scale the trainer linear->multi-layer, toward an11211
nx_nofloat_mlp4.nxCLOSE THE GAP from nx_nofloat_mlp (the 2-2-1 hit the predict-~0.5 local min). A 2-4-1 ReLU11211
nx_nofloat_mm_i8_batch_gate.nxSTEP 1 of the speculative serve integration (operator-approved build):12911
nx_nofloat_moe.nxno-float Mixture-of-Experts FFN (2026-07-15, MoE rung 1: the layer MECHANISM).1222
nx_nofloat_moe_block_gate.nxgates the MoE transformer BLOCK (MoE rung 2, 2026-07-15): per-token2687
nx_nofloat_moe_gate.nxgates the no-float MoE FFN layer (MoE rung 1, 2026-07-15). The lib does2856
nx_nofloat_moe_real_gate.nxMoE rung 3 (2026-07-15): REAL MoE WEIGHTS, LAZILY. Loads a real sparse-MoE3116
nx_nofloat_multihead_gate.nxHARD-EVIDENCE gate for MULTI-HEAD attention in pure integer Q16. The defining2529
nx_nofloat_multistep_gate.nxWHY no-float wins the MULTI-STEP-LOGIC arena (operator thesis 2026-06-18).625
nx_nofloat_muon.nxthe FULL Per-Head Muon optimizer LOOP in sovereign no-float (K3 F405; operator504
nx_nofloat_muon_gate.nxgate: the FULL Per-Head Muon optimizer loop (momentum + NS-orthogonalize +1514
nx_nofloat_muon_ns.nxSOVEREIGN no-float Newton-Schulz orthogonalization = the core of the Muon1137
nx_nofloat_muon_ns_gate.nxgate for integer Newton-Schulz orthogonalization (Muon core).832
nx_nofloat_mxfp4.nxSOVEREIGN no-float MXFP4 dequant (K3 F406 gap; operator 2026-07-19 "beyond SOTA").503
nx_nofloat_mxfp4_gate.nxgate for the no-float MXFP4 dequant (authored ON nx_gate_verdict).591
nx_nofloat_mxfp8.nxSOVEREIGN no-float MXFP8 dequant (K3 F406; operator 2026-07-19 "state of the art").755
nx_nofloat_mxfp8_gate.nxgate: MXFP8 (OCP E4M3 + E5M2) dequant to Q16, EXACT known values.711
nx_nofloat_olmoe.nxthe faithful OLMoE transformer LAYER in deterministic no-float (MoE rung 4,1852
nx_nofloat_olmoe_forward_gate.nxMoE rung 5 (2026-07-15): a COMPLETE OLMoE forward -- 16 stacked2946
nx_nofloat_olmoe_gate.nxMoE rung 4 (2026-07-15): a FAITHFUL OLMoE transformer LAYER on REAL blk.02217
nx_nofloat_prefix_cache_gate.nxproves the PREFIX-KV-CACHE speed optimization is BIT-EXACT + measures the1223
nx_nofloat_propose_chat_gate.nxPROPOSE->VERIFY rung 3 (2026-07-15): a BETTER PROPOSER on the SAME2051
nx_nofloat_propose_solve_gate.nxPROPOSE->VERIFY rung 2 (2026-07-15): SOLVE-FORMS. Rung 1 proved the2091
nx_nofloat_propose_verify_gate.nxTHE PROPOSE->VERIFY LOOP, rung 1 (2026-07-15). The sovereign no-float1791
nx_nofloat_prose_gate.nxCAP-NF-PROSE: the no-float char-LM trains on REAL ENGLISH PROSE (words + spaces,1466
nx_nofloat_q6k_gate.nxsovereign Q6_K -> Q16 integer dequant (unlocks Qwen embeddings + LM head).1556
nx_nofloat_quant_gate.nxCAP-NF-QUANT: post-training QUANTIZATION for efficient sovereign inference,16313
nx_nofloat_qwen_bias_probe.nxrecon: does Qwen2.5 carry Q/K/V projection biases (a known Qwen2 detail465
nx_nofloat_qwen_config_gate.nxrung 2a: read the REAL Qwen2.5-0.5B config from GGUF metadata.946
nx_nofloat_qwen_decode_gate.nxTOKENIZER decode: token id -> text, from the real GGUF vocab.915
nx_nofloat_qwen_diag_gate.nxFAITHFULNESS LOCALIZER (memory-safe: ONE no-float forward, lazy per-layer load).1305
nx_nofloat_qwen_dqprobe_gate.nxMEASUREMENT PROBE (not a milestone gate): isolate how much of a decode step994
nx_nofloat_qwen_encode_gate.nxBPE ENCODE: text -> token ids, sovereign, from the real GGUF merges+vocab.1317
nx_nofloat_qwen_encode_prep_gate.nxENCODE foundation: the BPE merges + the reverse (string -> id) lookup.886
nx_nofloat_qwen_fastgen_gate.nxKV-cached generation with a DEQUANT-ONCE weight+head cache.1594
nx_nofloat_qwen_fastgen_i32_gate.nxStage 1 of the decode-speed arc: the dequant-once cache narrowed1564
nx_nofloat_qwen_fastgen_i8_gate.nxStage 2a of the decode-speed arc: W8A8 SIMD decode (__i16x16_madd,1614
nx_nofloat_qwen_fidelity_gate.nxFIDELITY: the library's no-float Q16 matmul vs IEEE f32 on a REAL Qwen835
nx_nofloat_qwen_forward_gate.nxCAPSTONE: a COMPLETE sovereign no-float Qwen2.5-0.5B forward.1183
nx_nofloat_qwen_gen_gate.nxGREEDY MULTI-TOKEN GENERATION through the sovereign no-float Qwen2.5-0.5B.1214
nx_nofloat_qwen_kvgen_gate.nxKV-CACHED greedy generation through the sovereign no-float Qwen2.5-0.5B.1665
nx_nofloat_qwen_rope_h2h_gate.nxARCH H2H: the library's no-float Q16 RoPE vs the reference f32 RoPE.784
nx_nofloat_qwen_stack_gate.nxSTACK real Qwen layers (lazy per-layer load), deterministic no-float.833
nx_nofloat_qwen_text_gate.nxGRAND FINALE: text -> text through the sovereign no-float Qwen2.5-0.5B.1224
nx_nofloat_qwen_tok_gate.nxTOKENIZER CHECK (fast, no forward): BPE-encode a multi-word prompt and print the525
nx_nofloat_qwen_wload_gate.nxexercises the canonical library's by-name Q16 loader over the real model's814
nx_nofloat_rope_gate.nxHARD-EVIDENCE gate for RoPE (rotary position embedding) backward + RoPE composed1869
nx_nofloat_sample_gate.nxTEMPERATURE SAMPLING decode in pure integer Q16 (CAP-NF-SAMPLE). Real LLMs1138
nx_nofloat_scale2_gate.nxR4 DEPTH test: does a 2-BLOCK no-float LM reach the richer-grammar floor where1089
nx_nofloat_scale_batch_gate.nxR4 retry via the ONE untested fundamental lever: MINI-BATCH GRADIENT1167
nx_nofloat_scale_ffn_gate.nxR4 FINAL test: the COMPLETE transformer block (attention + FFN) on the richer1227
nx_nofloat_scale_gate.nxHONEST documented attempt mapping the frontier. On the richer1829
nx_nofloat_scale_research_fetch.nxSOVEREIGN researcher: GROUND the "how do we AFFORDABLY + EFFICIENTLY885
nx_nofloat_scale_wide_gate.nxR4 the genuine SCALE test: real WIDTH scale-up. Prior R4 tests stayed at1217
nx_nofloat_serialize_gate.nxCAP-NF-SERIALIZE: sovereign model PERSISTENCE (save/load trained weights).847
nx_nofloat_serve.nxthe DEPLOYABLE no-float LLM daemon (ops shell around the gated pure core1536
nx_nofloat_serve_core.nxthe PURE CORE of the no-float LLM serve organ (2026-07-10): model session +124438
nx_nofloat_serve_gate.nxgates the no-float LLM serve CORE in-process (pure-core+gate+daemon idiom:1577
nx_nofloat_serve_live_gate.nxLIVE socket proof for the no-float LLM daemon: connects to957
nx_nofloat_simd_dot_probe_gate.nxDECISIVE probe for Stage 2 (SIMD decode). Before rebuilding the whole1387
nx_nofloat_softmax_gate.nxa SYSTEM for the HARD no-float primitive: fixed-point exp + softmax.1076
nx_nofloat_speed_bench.nxhonest tok/s baseline for the no-float Qwen serve (the inference-speed arc's646
nx_nofloat_tok.nxcanonical sovereign BPE tokenizer library for the GGUF vocab (ONE source of truth).18210
nx_nofloat_tokdec.nxbyte-level-BPE piece decoder (GPT-2/Qwen convention): GGUF vocab pieces are UTF-8532
nx_nofloat_train.nxSOVEREIGN NO-FLOAT TRAINING CORE (ledger #1, the biggest gap). Integer Q16 fixed-point837
nx_nofloat_train_exceed.nxthe MEASURED S-class exceed for no-float TRAINING. Extends the established1235
nx_nofloat_transformer.nxSOVEREIGN NO-FLOAT TRANSFORMER BLOCK (the AI culmination), pure integer Q16,11813
nx_nofloat_vs_float_gate.nxCROSS-VALIDATION: do we need the float equivalent? Answer: it already EXISTS1209
nx_nofloat_w4_gemm_gate.nxTHE DECISIVE W4A16 EXPERIMENT (de-risks the inference-speed arc before any1617
nx_nofloat_weightconv_gate.nxthe BRIDGE: load REAL BF16 model weights -> no-float Q16 integer.1004
nx_nofloat_weighttie_gate.nxCAP-NF-WEIGHTTIE: tied input-embedding / output-projection (GPT-style1108
nx_nofloat_xformer_gate.nxHARD-EVIDENCE gate for the TRANSFORMER-SUBLAYER backward ops added to the22011