nx_cdx_parse.nx
buildroot/runtime/nx_cdx_parse.nx
about
nx_cdx_parse.nx -- LIB: parse Wayback / Common-Crawl CDX index rows into temporal-index inputs. A CDX row is
space-delimited: "urlkey timestamp original mimetype statuscode digest length", e.g.
com,page3)/ 19971211090223 http://www.page3.com:80/ text/html 200 <digest> 909
cdx_rows splits a CDX buffer into row [start,end) spans; cdx_field extracts the i-th space-delimited field of a
row; cdx_ts8 converts the 14-digit YYYYMMDDhhmmss timestamp to a YYYYMMDD int for nx_temporal_index. Zero-dep,
byte-exact. license_tier: ORIGINAL
dependencies 1 imports · 7 importers
imports: nx_syscalls.nx
imported by: nx_archive_capture_demo.nxnx_archive_media_fetch.nxnx_archive_site_viewer.nxnx_archive_viewer.nxnx_archive_xcapture_fetch.nxnx_cdx_parse_gate.nxnx_media_xrecover.nx
structs
| none |
consts
| none |
functions
| 10 | func cdx_rows(buf: *u8, n: i64, rowstarts: *i64, rowends: *i64, cap: i64) -> i64 |
| 25 | func cdx_field(buf: *u8, rs: i64, re: i64, idx: i64, out2: *i64) -> i64 |
| 44 | func cdx_ts8(buf: *u8, off: i64, len: i64) -> i64 |