Nishi Family › Compare › Web Search and Crawling
Web Search and Crawling — mechanically measured, liar-killed, sovereign.
Nishi vs Mojeek and Brave Search and Google and Marginalia
| Capability | Nishi | Mojeek | Brave | Marginalia | Notes | |
|---|---|---|---|---|---|---|
| BM25 relevance ranking | Yes | Yes | Yes | Yes | Yes | Integer Okapi BM25 (idf_q10); every engine ranks |
| Inverted index | Yes | Yes | Yes | Yes | Yes | Classic posting-list index |
| Phrase / positional search | Yes | Yes | Yes | Yes | Part | Positional postings (NXQ1 sidecar) |
| Stemming / morphology | Yes | Yes | Yes | Yes | Part | Porter-lite query+index stemming |
| Dense / vector retrieval | Yes | No | Part | Yes | No | Integer cosine k-NN; Google neural, Brave partial |
| Own independent crawler | Yes | Yes | Yes | Yes | Yes | Sovereign TLS crawler; all run their own crawl |
| Web-graph authority (PageRank) | Yes | Yes | Yes | Best | Part | Integer power-iteration; Google invented it |
| HTML content extraction | Yes | Yes | Yes | Yes | Yes | Block-aware boilerplate strip |
| Common Crawl ingest (index-only) | Yes | No | No | Part | Part | CDX + range-fetch, Memex-style; majors use own crawl |
| Deep-research answer loop | Yes | No | Part | Best | No | Fetch to read QA; Google AI Overviews, Brave answers |
| Neural rerank / trained encoder | No | No | Part | Best | No | Cross-encoder rerank; Nishi's number-one gap |
| Web-scale index (billions+) | No | Yes | Yes | Best | Yes | Mojeek/Brave billions, Google trillions; Nishi ~10^3 slice |
| JS-rendered crawling | No | Part | Part | Best | No | Headless render; Nishi static-HTML only |
| Sovereign -- own language, compiler, TLS, index (zero third-party) | Best | No | No | No | Part | No Python/C/cloud beneath; Marginalia lean but on JVM/Linux |
| Neutral by construction -- no ads, no profiling, down-rank not delete | Best | Part | Part | No | Part | Quality filter demotes slop, never censors; Google ad-ranked + profiled |
| Zero-JS, zero-tracker, integer-deterministic SERP | Best | No | No | No | No | About 5 KB no-JS page, bit-reproducible results |
Generated by nx_swcompare_matrix (sovereign NishiLang organ) from knowledge/compare/search.matrix — every Nishi cell verified against real organ source on disk. Zero JS, zero trackers.