code wiki / (root) / nx_crawl_run.nx

nx_crawl_run.nx

buildroot/runtime/nx_crawl_run.nx

4633 B109 linesdepth 6pulls 17 transitivereach 0 importersview sourcekind tooltopic crawl
docsdependenciesstructsconstsfunctions

about

nx_crawl_run.nx -- end-to-end crawl: fetch (real HTTP) -> extract -> dedup -> index -> search, over the loopback mock-web. Proves the whole sovereign loop AND that the engine finds uncensored content (the adult-aggregator page) once crawled -- the answer to "did our search find it": it does, once it crawls, with no prudish category-censorship.

dependencies 6 imports · 0 importers

fx.nx nx_str.nx nx_http_client.nx nx_html_to_text.nx nx_simhash.nx nx_bm25.nx nx_crawl_run.nx

imports: fx.nxnx_str.nxnx_http_client.nxnx_html_to_text.nxnx_simhash.nxnx_bm25.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main nx_str_len nx_inv_new nx_puts nx_str_len ↻ nx_body_off nx_html_to_text nx_html_to_text_x h2t_state_new sys_mmap nxa_die sys_write sys_exit nxa_lock_take nxa_lock_addr sys_write ↻ nxa_lock_give nxa_lock_addr ↻ nxa_report_overrun sys_write ↻ nxa_dump_printable nxa_dump_sizes sys_mmap ↻ h2t_scan_tag h2t_skip_to_gt h2t_scan_name h2t_is_name h2t_is_block_tag h2t_name_eq_lit h2t_lc h2t_lc ↻ h2t_is_suppress_tag h2t_name_eq_lit ↻ h2t_emit_newline h2t_name_eq_lit ↻ h2t_emit_raw h2t_find_href h2t_lc ↻ h2t_is_name ↻ h2t_decode_entity

structs

none

consts

12const K_MAGIC_8088: i64 = 8088
13const K_MAGIC_16384: i64 = 16384
14const K_MAGIC_8192: i64 = 8192

functions

16func nx_putc(c: i64) -> i64 { let b: *u8 = sys_mmap(1); b[0] = c; sys_write(1, b, 1); return 0 }
17func nx_puts(s: *u8) -> i64 { sys_write(1, s, nx_str_len(s)); return 0 }
called by 2: nx_crawl_searchmain calls 1: nx_str_len
18func nx_put_i64(n: i64) -> i64
called by 1: main calls 1: nx_putc
27func nx_body_off(resp: *u8, n: i64) -> i64
called by 1: main
54func main() -> i64