code wiki / (root) / nx_crawl_https.nx

nx_crawl_https.nx

buildroot/runtime/nx_crawl_https.nx

6660 B138 linesdepth 21pulls 139 transitivereach 0 importersview sourcekind tooltopic crawl

docs dependencies structs consts functions

about

nx_crawl_https.nx -- the hardened crawler on the REAL VALIDATED HTTPS web. Governed (ISP-safe) + robots-respecting + content-deduped + indexed + persisted, every fetch a VALIDATED TLS 1.3 session (nx_https_get + bits-up CA store). The deployable pipeline, end-to-end, against the live HTTPS internet.

dependencies 12 imports · 0 importers

diagram shows first 10 each side; +2 more imports, +0 more importers in the complete lists below.

imports: nx_str.nxnx_syscalls.nxnx_csprng.nxnx_x509_trust_store.nxnx_pem_loader.nxnx_https_get.nxnx_html_to_text.nxnx_simhash.nxnx_bm25.nxnx_robots.nxnx_net_governor.nxnx_docstore.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

structs

none

consts

17	const K_MAGIC_2097152: i64 = 2097152
18	const K_MAGIC_131072: i64 = 131072
19	const K_MAGIC_262144: i64 = 262144

functions

21	func nx_putc(c: i64) -> i64 { let b: *u8 = sys_mmap(1); b[0] = c; sys_write(1, b, 1); return 0 } called by 2: nx_pi main calls 2: sys_mmap sys_write
22	func nx_puts(s: *u8) -> i64 { sys_write(1, s, nx_str_len(s)); return 0 } called by 1: main calls 2: sys_write nx_str_len
23	func nx_pi(n: i64) -> i64 called by 1: main calls 3: nx_putc sys_mmap sys_write
31	func nx_body_off(resp: *u8, n: i64) -> i64 called by 1: main
37	func nx_pathof(url: u8, out: u8, cap: i64) -> i64 called by 1: main calls 1: nx_str_len
54	func main() -> i64 calls 27: nx_puts trust_store_alloc nx_pem_trust_load_file nx_pi nx_putc sys_mmap+21