code wiki / _hdl_build / nx_web_purge_slop.nx

nx_web_purge_slop.nx

buildroot/runtime/_hdl_build/nx_web_purge_slop.nx

9819 B184 linesdepth 5pulls 10 transitivereach 0 importersview sourcekind tooltopic web
docsdependenciesstructsconstsfunctions

about

nx_web_purge_slop.nx -- SCOPED SLOP PURGE for the web shard (2026-08-04, debt 1785895889): every url:-keyed doc already ingested is re-judged against the MEASURED bad classes ONLY -- tag/category listing farms (the ruler's SERP pollution) + the interstitial content markers the live crawler refuses (verification/challenge walls). An offender's pol:<cid> row is banked as "2" (AI_BLOG bit only -- the SEARCH bit cleared), which the query-time owner-consent check enforces IMMEDIATELY and REVERSIBLY (re-bank "1" to restore); no doc row is deleted (rule 13: additive-only, history sacred). Default is a DRY RUN; pass `commit` to write. usage: nx_web_purge_slop <domain> [commit] [maxrows] SINGLE-WRITER CAUTION: run while the crawl beat is idle (searchcrawl defers during compact; this organ takes seconds) -- segid is claimed at COMMIT time via ss_next_segid to shrink the race window. license_tier: ORIGINAL

dependencies 1 imports · 0 importers

nx_corpus_ingest.nx nx_web_purge_slop.nx

imports: nx_corpus_ingest.nx

imported by: nobody (leaf or entry point)

call flow from main pre-order; caps 40 nodes / depth 6 declared; ↻ = already shown

main ps_puts ps_atoi dss_prefix ss_open ss_open2 sys_mmap ss_manifest_dyn ss_manifest_file_dyn sys_mmap ↻ ss_cat ss_readall sys_openat_rd sys_lseek sys_mmap ↻ sys_read sys_close sys_munmap ss_cat ↻ ss_loadfile sys_map_file sys_openat_rd ↻ sys_lseek ↻ sys_close ↻ ss_readall ↻ ss_load_aux2 sys_mmap ↻ ss_cat ↻ ss_loadfile ↻ ss_r32 sys_munmap ↻ ssl_total_keys ss_r32 ↻ ssl_pow2 ssl_build ss_r32 ↻ ssl_hash_entry ss_r32 ↻ ssl_key_eq ss_r32 ↻

structs

none

consts

13const K_MAGIC_20000: i64 = 20000

functions

15func ps_puts(s: *u8) -> i64 { var n: i64 = 0; while s[n] != (0 as u8) { n = n + 1 } sys_write(1, s, n); return 0 }
called by 1: main
16func ps_num(v: i64) -> i64
called by 1: main
26func ps_hassub(hay: *u8, hn: i64, lit: *u8) -> i64
46func ps_is_slop_url(u: *u8, ul: i64) -> i64
called by 1: main calls 1: ps_hassub
54func ps_is_interstitial(doc: *u8, dn: i64) -> i64
called by 1: main calls 1: ps_hassub
63func ps_atoi(s: *u8) -> i64 { var v: i64 = 0; var i: i64 = 0; while s[i] != (0 as u8) { let c: i64 = s[i] as i64; if c >= 48 { if c <= 57 { v = v * 10 + (c - 48) } } i = i + 1 } return v }
called by 1: main
65func main(argc: i64, argv: *i64) -> i64