code wiki / blockfloat

topic: blockfloat

6 modules sharing the blockfloat name family (derived from the tree's prefix discipline).

moduledescriptionlinesfuncs
nx_blockfloat_block_gate.nxBLOCK-FLOAT weights through the REAL no-float TRANSFORMER BLOCK. Composes the17811
nx_blockfloat_ddp_gate.nxTHE CONVERGENCE: block-float weights inside DETERMINISTIC DISTRIBUTED training.14613
nx_blockfloat_generate_gate.nxR2 of the model-assembly arc: AUTOREGRESSIVE GENERATION on block-float weights.24218
nx_blockfloat_lm_gate.nxFULL LM FORWARD with block-float weights: the first rung of the model-assembly arc.20315
nx_blockfloat_mha_gate.nxBLOCK-FLOAT weights through REAL MULTI-HEAD attention. Composes the existing17413
nx_blockfloat_stack_gate.nxBLOCK-FLOAT weights through a STACKED (multi-block) transformer -- the step18813