Nishi Family › Compare › Frontier Radar

Frontier Radar — Web Scraping and Extraction

Where the 2025/26 research frontier is moving, and where Nishi should test, deepen, or research next.

How this works. The nishi researcher banked the current (2024-2026) frontier for this domain over sovereign TLS (keyless OpenAlex/arXiv). For each capability axis this radar measures frontier momentum = how often the frontier corpus mentions it, times our organ presence (probed on disk). Absent + hot = a research opportunity / where to test. Corpus measured: 1633301 bytes. Generated by nx_swcompare_gapmap over a data-only domain spec (webscraping.q + webscraping.axes) — zero domain-specific code.
Top research opportunities (the 2025/26 frontier is active here and Nishi has no organ yet):
Capability axisNishi organFrontier momentum (2025/26)Signal
JS-rendered / headless scrapingabsent
54 mentions		OPPORTUNITY
Sovereign HTTP fetch (TLS)present
46 mentions		COVERED
Frontier-persisted crawlerpresent
38 mentions		COVERED
HTML content extractionpresent
6 mentions		COVERED
Common Crawl ingestpresent
4 mentions		COVERED
WARC archive parsepresent
4 mentions		COVERED
Anti-bot / CAPTCHA handlingabsent
4 mentions		OPPORTUNITY
Near-duplicate detectionpresent
0 mentions		COVERED
CDX capture-index querypresent
0 mentions		COVERED
Full-text index of scraped datapresent
0 mentions		COVERED
Byte-range fetchpresent
0 mentions		COVERED
Proxy rotation / residential IPsabsent
0 mentions		dormant
Media / asset harvestpresent
0 mentions		COVERED
LLM structured extractionabsent
0 mentions		dormant
Managed scheduling / scaleabsent
0 mentions		dormant

Opportunities 2 · covered 10 · dormant 3

frontier momentum is a mechanical keyword count over real 2024-2026 works; our presence is probed on disk. A discovery signal, not a ranking of importance. Zero JS, zero trackers.