code wiki / fnet
topic: fnet
6 modules sharing the fnet name family (derived from the tree's prefix discipline).
| module | description | lines | funcs |
|---|---|---|---|
| nx_fnet_grad_gate.nx | GATE for FNET-002: the FNet mixer's backward pass (VJP). Proves, by RUNNING, that | 170 | 5 |
| nx_fnet_mix.nx | FNET-001: SUB-QUADRATIC Fourier token-mixer (FNet, Lee-Thorp/Ainslie/Eckstein/Ontanon 2021). | 204 | 6 |
| nx_fnet_mix_gate.nx | GATE for FNET-001 sub-quadratic Fourier token-mixer. Proves, by RUNNING (never | 281 | 10 |
| nx_fnet_mlm_gate.nx | GATE for MODEL-002: a tiny MASKED LANGUAGE MODEL on the FNet mixer. FNet's Fourier | 270 | 9 |
| nx_fnet_model_gate.nx | GATE for MODEL-001: the FIRST end-to-end sovereign SUB-QUADRATIC MODEL. A real | 285 | 9 |
| nx_fnet_train_gate.nx | GATE for FNET-003: the trainable FNet block (arc convergence). Proves, by RUNNING: | 189 | 7 |