code wiki / _hdl_build / nx_langintel_gh_fetch.nx
nx_langintel_gh_fetch.nx
buildroot/runtime/_hdl_build/nx_langintel_gh_fetch.nx
about
nx_langintel_gh_fetch.nx v2 -- LangIntel FETCH stage, FULL-SCALE PAGINATION (no sampling): loops
GitHub pages (base_url + &page=N) forking nx_https_get each, accumulates every page body (sliced from
the first '['), and STOPS when a response has no Link rel="next". Writes the whole concatenation to a
.raw (the anchor-based ingest parser scans across page seams -- concatenated arrays are fine).
Composes nx_https_get via dep_run_capture. ORACLE/bench-only (F616). Rule 26.
argv: <base-url-with-per_page-but-no-page> <out-raw-path> expect_exit: 0 license_tier: ORACLE-FETCH
dependencies 3 imports · 0 importers
imports: nx_ingest_base.nxnx_deploy_lib.nxnx_syscalls.nx
imported by: nobody (leaf or entry point)
call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown
structs
| none |
consts
| 11 | const GF_STDERR: i64 = 2 |
| 12 | const GF_CAP: i64 = 16777216 |
| 13 | const GF_ACC: i64 = 16777216 |
| 14 | const GF_MODE: i64 = 420 |
| 15 | const GF_MAXPAGE: i64 = 60 |
| 16 | const GF_URLCAP: i64 = 2048 |
| 17 | const GF_ARGC_MIN: i64 = 3 |
| 18 | const GF_EXIT_USAGE: i64 = 2 |
| 19 | const GF_EXIT_IO: i64 = 1 |
| 20 | const GF_EXIT_RED: i64 = 3 |
| 21 | const GF_HTTPS_ELF: *u8 = "/volume1/homes/elderwesto/nishihost/nx_https_get.elf" as *u8 |
| 22 | const GF_TMP: *u8 = "/tmp/langintel_ghfetch.out" as *u8 |
| 23 | const GF_LBRACK: *u8 = "[" as *u8 |
| 24 | const GF_PAGEARG: *u8 = "&page=" as *u8 |
| 25 | const GF_NEXT: *u8 = "rel=\"next\"" as *u8 |
functions
| 27 | func main(argc: i64, argv: *i64) -> i64 |