code wiki / _hdl_build / nx_bench_warc.nx

nx_bench_warc.nx

buildroot/runtime/_hdl_build/nx_bench_warc.nx

12047 B269 linesdepth 23pulls 135 transitivereach 0 importersview sourcekind benchtopic bench
docsdependenciesstructsconstsfunctions

about

nx_bench_warc.nx -- BENCHMARK CORPUS CAPTURE RUNNER: a URL-list file -> render-fetched -> ONE durable WARC at a CALLER-CHOSEN path -> reloaded and verified retrievable by URL -> ts'd verdict line appended to knowledge/status/bench_warc.log. Composes bf_fetch_follow (render front) + nx_web_archive (store); adds NO new mechanism. Exists because nx_crawl_preserve pins one output path + a 32MiB cap, so it cannot hold two vertical corpora side by side (archive-as-oracle standard: every benchmark corpus is a reserved WARC). usage: nx_bench_warc <urlfile> <warcpath> [max] (urlfile: one URL per line; blank/# lines skipped) license_tier: ORIGINAL

dependencies 6 imports · 0 importers

nx_syscalls.nx nx_x509_trust_store.nx nx_trust_store_load_from_certdata. nx_csprng.nx nx_browser_fetch.nx nx_web_archive.nx nx_bench_warc.nx

imports: nx_syscalls.nxnx_x509_trust_store.nxnx_trust_store_load_from_certdata.nxnx_csprng.nxnx_browser_fetch.nxnx_web_archive.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main bw_w sys_write sys_mmap bw_readfile sys_openat_rd sys_read sys_close bw_conf bw_sl bw_n sys_mmap ↻ sys_write ↻ nx_trust_store_load_from_c sys_mmap ↻ sys_read_file sys_openat_rd ↻ sys_lseek sys_mmap ↻ sys_read ↻ sys_close ↻ nx_nss_certdata_parse sys_mmap ↻ _pat_class_cert _pat_value_octal _pat_end _find_newline _starts_with _parse_octal_line sys_mmap ↻ _is_space _decode_octal_escape _is_octal trust_store_alloc sys_mmap ↻ nx_x509_trust_store_load sys_mmap ↻ x509_parse sys_mmap ↻ asn1_cursor_init

structs

none

consts

15const BW_CERTCAP: i64 = 4194304
16const BW_LOGCAP: i64 = 1024
17const BW_REDIR: i64 = 5
18const BW_MODE: i64 = 420
19const BW_CONFCAP: i64 = 8192
23const BW_D_RESPCAP: i64 = 33554432
24const BW_D_WARCCAP: i64 = 805306368
25const BW_D_LISTCAP: i64 = 4194304
26const BW_D_URLCAP: i64 = 4096
27const BW_D_MAXURLS: i64 = 100000
28const BW_HDRSLACK: i64 = 4096

functions

30func bw_w(s: *u8) -> i64 { var n: i64 = 0; while s[n] != (0 as u8) { n = n + 1 } sys_write(1, s, n); return 0 }
called by 1: main calls 1: sys_write
31func bw_sl(s: *u8) -> i64 { var n: i64 = 0; while s[n] != (0 as u8) { n = n + 1 } return n }
called by 2: bw_confmain
32func bw_n(v: i64) -> i64
called by 1: main calls 2: sys_mmapsys_write
46func bw_catn(buf: *u8, off: i64, v: i64) -> i64
called by 1: main calls 1: sys_mmap
58func bw_cat(buf: *u8, off: i64, s: *u8) -> i64
called by 1: main
64func bw_readfile(path: *u8, buf: *u8, cap: i64) -> i64
called by 1: main calls 3: sys_openat_rdsys_readsys_close
72func bw_line(list: *u8, start: i64, end: i64, url: *u8, urlcap: i64) -> i64
called by 1: main
94func bw_conf(buf: *u8, n: i64, key: *u8, dflt: i64) -> i64
called by 1: main calls 1: bw_sl
117func main(argc: i64, argv: *i64) -> i64
calls 23: bw_wsys_mmapbw_readfilebw_confbw_nnx_trust_store_load_from_certdata+17