code wiki / (root) / nx_crawl_run.nx

nx_crawl_run.nx

buildroot/runtime/nx_crawl_run.nx

4633 B109 linesdepth 6pulls 17 transitivereach 0 importersview sourcekind tooltopic crawl
docsdependenciesstructsconstsfunctions

about

nx_crawl_run.nx -- end-to-end crawl: fetch (real HTTP) -> extract -> dedup -> index -> search, over the loopback mock-web. Proves the whole sovereign loop AND that the engine finds uncensored content (the adult-aggregator page) once crawled -- the answer to "did our search find it": it does, once it crawls, with no prudish category-censorship.

dependencies 6 imports · 0 importers

fx.nx nx_str.nx nx_http_client.nx nx_html_to_text.nx nx_simhash.nx nx_bm25.nx nx_crawl_run.nx

imports: fx.nxnx_str.nxnx_http_client.nxnx_html_to_text.nxnx_simhash.nxnx_bm25.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main nx_http_client_sockaddr_ip nx_str_len nx_inv_new nx_puts nx_str_len ↻ nx_http_client_get sys_socket nx_connect_bounded nx_fcntl sys_connect sys_mmap sys_poll sys_close sys_mmap ↻ nx_http_client_build_reque hc_put_caps sys_mmap ↻ nx_codec_caps_headers sys_mmap ↻ nx_codec_caps_accept_docum sys_mmap ↻ nx_codec_caps_accept_image nx_cc_put nx_codec_caps_accept_encod cc_encoding_have nx_cc_put ↻ cc_encoding_name nx_cc_put ↻ sys_write _drain sys_read nx_body_off nx_html_to_text nx_html_to_text_x h2t_state_new sys_mmap ↻ sys_mmap ↻ h2t_scan_tag h2t_skip_to_gt

structs

none

consts

12const K_MAGIC_8088: i64 = 8088
13const K_MAGIC_16384: i64 = 16384
14const K_MAGIC_8192: i64 = 8192

functions

16func nx_putc(c: i64) -> i64 { let b: *u8 = sys_mmap(1); b[0] = c; sys_write(1, b, 1); return 0 }
17func nx_puts(s: *u8) -> i64 { sys_write(1, s, nx_str_len(s)); return 0 }
called by 2: nx_crawl_searchmain calls 1: nx_str_len
18func nx_put_i64(n: i64) -> i64
called by 1: main calls 1: nx_putc
27func nx_body_off(resp: *u8, n: i64) -> i64
called by 1: main
54func main() -> i64