code wiki / (root) / nx_live_crawl.nx

nx_live_crawl.nx

buildroot/runtime/nx_live_crawl.nx

3638 B77 linesdepth 6pulls 17 transitivereach 0 importersview sourcekind tooltopic live
docsdependenciesstructsconstsfunctions

about

nx_live_crawl.nx -- LIVE crawl of a real internet host via the sovereign stack (our DNS resolver + our HTTP client + our HTML extractor + our index). Target: info.cern.ch (the first website; serves plain HTTP on :80, so it works with our no-TLS-yet client). Honest scope: HTTP-only until the crawler gets the TLS layer the browser already has.

dependencies 7 imports · 0 importers

fx.nx nx_str.nx nx_dns_resolve_a_record.nx nx_http_client.nx nx_html_to_text.nx nx_bm25.nx nx_search_inverted.nx nx_live_crawl.nx

imports: fx.nxnx_str.nxnx_dns_resolve_a_record.nxnx_http_client.nxnx_html_to_text.nxnx_bm25.nxnx_search_inverted.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main nx_str_len nx_puts nx_str_len ↻ nx_dns_resolve_default nx_dns_resolve_with_failov nx_dns_resolve_a_record sys_mmap nx_dns_build_query nx_dns_put_u16_be nx_dns_encode_name sys_socket sys_set_socket_timeout sys_mmap ↻ sys_setsockopt sys_munmap sys_sendto sys_close sys_recvfrom nx_dns_parse_response_a nx_dns_get_u16_be nx_dns_skip_name nx_pi nx_putc nx_putc ↻ nx_http_client_sockaddr_ip nx_http_client_get sys_socket ↻ nx_connect_bounded nx_fcntl sys_connect sys_mmap ↻ sys_poll sys_close ↻ sys_mmap ↻ nx_http_client_build_reque hc_put_caps sys_mmap ↻ nx_codec_caps_headers sys_mmap ↻

structs

none

consts

none

functions

15func nx_putc(c: i64) -> i64 { let b: *u8 = sys_mmap(1); b[0] = c; sys_write(1, b, 1); return 0 }
called by 3: nx_pinx_reportmain
16func nx_puts(s: *u8) -> i64 { sys_write(1, s, nx_str_len(s)); return 0 }
called by 2: nx_reportmain calls 1: nx_str_len
17func nx_pi(n: i64) -> i64
called by 2: nx_reportmain calls 1: nx_putc
24func nx_body_off(resp: *u8, n: i64) -> i64
called by 1: main
29func nx_report(text: *u8, tlen: i64, q: *u8) -> i64
called by 1: main calls 6: nx_bm25_tfnx_inv_hash_bytes_lowernx_str_lennx_putsnx_pinx_putc
35func main() -> i64
calls 14: nx_str_lennx_putsnx_dns_resolve_defaultnx_pinx_putcnx_http_client_sockaddr_ipv4+8