Nishi vs the Field -- Web Scraping and Extraction

How this is scored. Every Nishi cell is measured: the generator reads the real organ source on disk and requires the implementing symbol to exist (no self-grading). Competitor cells record documented capability presence. Best=leads this axis, Yes=present, Part=partial, No=absent. This is capability presence, not depth or scale: the majors lead on index size and neural ranking. Nishi's genuine exceeds are the sovereignty / neutrality / determinism axes.

Capability	Nishi	Firecrawl	Apify	Bright Data	Zyte	Notes
Sovereign HTTP fetch (TLS)	Yes	Yes	Yes	Yes	Yes	All fetch over HTTP; Nishi owns its TLS
Byte-range fetch	Yes	Yes	Yes	Yes	Yes	Partial / resumable fetch
Frontier-persisted crawler	Yes	Yes	Yes	Yes	Yes	Resumable BFS crawl frontier
HTML content extraction	Yes	Best	Yes	Yes	Yes	Firecrawl leads (clean markdown extract)
Media / asset harvest	Yes	Yes	Yes	Yes	Yes	Image / video / stream URL extract
Near-duplicate detection	Yes	Part	Part	Yes	Part	Content dedup; Bright Data mature
Common Crawl ingest (index-only)	Yes	No	No	No	Part	CDX + range-fetch, Memex-style
WARC archive parse	Yes	No	No	No	No	Web-archive format; live scrapers do not
CDX capture-index query	Yes	No	No	No	No	Wayback / Common Crawl capture index
Full-text index of scraped data	Yes	No	Part	Part	Part	Nishi indexes; platforms mostly deliver raw
JS-rendered / headless scraping	No	Best	Best	Yes	Yes	Firecrawl / Apify lead; Nishi static-HTML only
Proxy rotation / residential IPs	No	Yes	Best	Best	Yes	Bright Data leads (residential pool); Nishi none
Anti-bot / CAPTCHA handling	No	Best	Yes	Best	Yes	Bypass / solve; Nishi none
LLM structured extraction	No	Best	Yes	Yes	Yes	Firecrawl leads (schema / JSON extract); Nishi none
Managed scheduling / scale	No	Yes	Best	Best	Best	Apify actors + cloud scale; Nishi operator-stepped
Sovereign -- own language, compiler, TLS, index (zero SaaS dep)	Best	No	No	No	No	All four are paid SaaS on big-cloud; Nishi owns the stack
Runs on your hardware, zero cost, integer-deterministic	Best	No	No	No	No	No per-request billing, no vendor lock, reproducible

Honest verdict. Nishi has broad, sovereign search-engine presence — a real organ behind every core ranking and crawl axis, built bits-up in one language. It is not yet a scale or neural-ranking rival: the majors lead on index size (billions to trillions vs a Common-Crawl-seeded slice) and trained rerankers. Nishi's genuine exceeds are structural — owning the whole stack, neutrality by construction, and a zero-JS integer-deterministic result page. The climb is a bigger index and a trained reranker.

Generated by nx_swcompare_matrix (sovereign NishiLang organ) from knowledge/compare/webscraping.matrix — every Nishi cell verified against real organ source on disk. Zero JS, zero trackers.