Nishi Family › Compare › Automated Testing and Competitive Intel (Racing Crew)
Nishi Compare · capabilities, evidence and delivery
Automated Testing and Competitive Intel (Racing Crew)
Compare capabilities and delivery evidence. Source discovery, qualification, deployment and accepted outcomes are separate; an open contract names work still to verify.
Nishi vs Playwright and Cypress and Selenium and Applitools
Overview
The purpose, declared position and evidence coverage of this domain. Source presence and completed acceptance are different measures.
Where we are. Measured 2026-08-19. The crew tests the SHIPPED BYTES (wasm on our own VM, vision forensics, seeded repro) and runs competitive intel as a primitive; what it lacks is the interactive half of the field: no real-browser driver, no locator API, no mocking, no flaky quarantine, no codegen, no CI surface, no a11y organ. The a11y rulers (nx_uiq_atree, nx_uiq_contrast, page_verify a11y count) exist separately and the driver precedent exists as a laptop PowerShell wire -- both are composition rungs, not inventions.
Where we need to go. Drive real pages from an organ, script journeys on it, and turn the gate journals into the CI surface -- then scale over the swarm and learn selectors and triage on the sovereign seat, keeping the shipped-bytes harness as the exceed the browser-automation field does not have.
Latest recorded release
No valid dated release entry is recorded for this domain.
Release entries describe recorded changes; they do not establish that every capability passed evaluation.
10 of 20 capability source symbols found|2 of them authored stronger-claims|10 open|coverage 500/1000|adoption 2 full / 8 partial
Evidence profile — what the gaps on this board actually are
Measured by nx_swcompare_evidence, read back by nx_evprofile_lib. Every figure is a count with its denominator — there is deliberately no score, no grade and no percentage anywhere in this band, because a stored scalar is a field a seat can edit and a counted partition is not.
evidence|grounded 10/10|unsupported 0|gates green 2/2|proven able to fail 2/2|never bitten 0|green at 0/0 1|open gaps 10|of them unnamed 0|of them proof withheld 0|flips ready 0
proven able to fail counts the gates that have a RECORDED RED — nx_gate_bite mutated the gate subject, rebuilt it, watched the gate go red, and that record is inside the shared TTL. never bitten is its complement over the same denominator: those gates ran and were green, and nothing has ever shown them able to detect anything, so their green is a statement about this run and not about the gate. green at 0/0 is a separate and much weaker observation — the gate printed GREEN on a zero denominator, so its own tooth counter says it examined nothing. A gate can be green, non-zero, and still never bitten; that is the common case and it is now visible instead of implied.
partition: grounded + unsupported = 10 vs present 10 · named + unnamed + withheld = 10 vs open 10 · both reconcile
liar-kill conj=GPQN · all four conjuncts held
graded document: BUILDROOT tree, 6690 bytes · gates map: PRIMARY · stamped 0d 16h ago · source ../knowledge/status/evstamp_racing.verdict
| Gap class | What it is, and the work it names |
|---|---|
| VACUOUS-GATE | A gate reported GREEN on a ZERO denominator. A gate with real teeth and a broken counter, and a gate with no teeth at all, are indistinguishable from outside; that indistinguishability is the finding, so it is reported here and never convicted. |
nx_swcompare_evidence racing itself and are not carried on the stamp, so this page names the classes and the producer names the rows. That split is stated rather than hidden: a count without a worklist is not actionable, and this band is honest about which half of that it is.Production map
Follow the dependencies, declared acceptance criteria and recorded priorities. Inspect source binding before treating a rank as executable work.
Ranking source binding: STALE_OR_INVALID_BINDING. Recorded priorities require current acceptance evidence and resource checks before execution.
Recorded ranking withheld
Retained ranking is not bound to the current plan and matrix: STALE_OR_INVALID_BINDING. Historical data remains retained. Refresh the ranking after resolving the input differences. Latest execution outcome is unverified.
Declared roadmap — contract, acceptance, executor, effort
| Rung | Closes with | Definition of done (pre-declared) | Executor | Est. |
|---|---|---|---|---|
| Sovereign browser driver (CDP and the Nishi browser) (R0) | wd_session | An organ drives a real page -- navigate, click, type, wait, screenshot -- over CDP to Chromium and natively to the sovereign browser; the laptop-side nx_cdp.ps1 wire that proved WebGPU is the break-glass precedent this rung retires into an organ | Organ | 3 u |
| Locator API with auto-wait (R1) after R0 | e2e_locate | Role, text and CSS locators with auto-wait semantics over the driver; a scripted journey on /compare and /survey runs green and a planted DOM change fails it | Organ | 2 u |
| Flaky detection and quarantine (R3) | fl_quarantine | Re-run statistics over the gate roster journal name flaky gates by measurement; quarantined gates still run and report, they stop blocking; the list is printed, never a count alone | Organ | 1 u |
| CI reports from the gate journals (R4) | tr_report | JUnit-class XML plus a per-run page derived from gateroster.jrnl and biteall.log; every row links to its gate and seed | Organ | 1 u |
| Accessibility audit organ (R5) | aa_audit | One axe-class report per page composing nx_uiq_atree, nx_uiq_contrast and the page_verify a11y count; runs over every compare page on the beat; a planted contrast defect turns it RED | Organ | 1 u |
| Network interception and mocking (R2) after R0 | nm_route | Route rules intercept and stub requests in the driven page; a journey runs against a mocked backend deterministically | Organ | 1.5 u |
| Record and codegen (R6) after R1 | tc_record | User actions recorded through the driver emit a replayable journey script; replay is byte-equal to the recording on the same build | Organ | 2 u |
| Visual self-healing locators (R7) after R1 | va_heal | A learned visual matcher re-finds a moved element and the healed locator is reported with its evidence; precision on a banked layout-drift set PRE-DECLARED | Local model | 3 u |
| Cross-browser grid on the swarm (R8) after R0 | tg_run | Journeys fan out over the mesh to Chromium, Firefox and the sovereign browser; a matrix of results with every cell a link | Organ | 2 u |
| LLM test authoring and triage (R9) after R1 | lt_author | The sovereign seat drafts journeys from a page and triages failures by seed and frame; every draft runs before it is admitted | Local model | 2 u |
Milestones
| Milestone | Rungs | Cumulative |
|---|---|---|
| M0 · Drive real pages | R0,R1 | 5 u |
| M1 · Suite hygiene | R3,R4,R5 | 8 u |
| M2 · Script everything | R2,R6 | 11.5 u |
| M3 · Scale and learn | R7,R8,R9 | 18.5 u |
| Class | Count | Note |
|---|---|---|
| bars | 0 | sotabar rows on the plan |
| fresh | 0 | the bar month is the current month |
| attested | 0 | an older bar with a this-month barscan reporting no newer entry |
| stale | 0 | a this-month scan saw a newer month the bar ignores |
| unattested | 0 | nobody looked this month |
| malformed | 0 | a sotabar row missing a field |
| duplicate | 0 | bar ids an earlier row already carries |
| bars, summed | 0 | RECONCILED: the parts sum to the total 0 |
| current month | 2026-10 | the month every bar is judged against |
Inspect a rung and its prerequisites
Declared nodes 10. Rank input binding: STALE_OR_INVALID_BINDING. Dependency order is authored. Implementation, acceptance evidence, authority and resource readiness are unverified. No action is recommended or dispatched here.
Plan SHA-256 30d28a164219eb07dce30cadfef153032d331e05c064aa9306b46b057726d490. Target rows 0; role rows 0. Existing risks and release worklog retain their own scope; no node completion is inferred.
Runtime observation coverage: 0 of 10 rungs have current, identity-bound execution observations. Observation may report RED. Accepted completion remains unknown; source presence, qualification and deployment do not establish it.
Use Enter or Space on a rung to inspect its contract. Prerequisite links locate another rung in this list; open its summary to inspect it. Estimates are authored effort, not forecasts.
R0 — Sovereign browser driver (CDP and the Nishi browser)
Prerequisites: None declared; this does not establish execution eligibility.
Contract:
wd_sessionAcceptance: An organ drives a real page -- navigate, click, type, wait, screenshot -- over CDP to Chromium and natively to the sovereign browser; the laptop-side nx_cdp.ps1 wire that proved WebGPU is the break-glass precedent this rung retires into an organ
Authored effort: 3. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R1 — Locator API with auto-wait
Prerequisites: R0 (acceptance unverified)
Contract:
e2e_locateAcceptance: Role, text and CSS locators with auto-wait semantics over the driver; a scripted journey on /compare and /survey runs green and a planted DOM change fails it
Authored effort: 2. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R3 — Flaky detection and quarantine
Prerequisites: None declared; this does not establish execution eligibility.
Contract:
fl_quarantineAcceptance: Re-run statistics over the gate roster journal name flaky gates by measurement; quarantined gates still run and report, they stop blocking; the list is printed, never a count alone
Authored effort: 1. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R4 — CI reports from the gate journals
Prerequisites: None declared; this does not establish execution eligibility.
Contract:
tr_reportAcceptance: JUnit-class XML plus a per-run page derived from gateroster.jrnl and biteall.log; every row links to its gate and seed
Authored effort: 1. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R5 — Accessibility audit organ
Prerequisites: None declared; this does not establish execution eligibility.
Contract:
aa_auditAcceptance: One axe-class report per page composing nx_uiq_atree, nx_uiq_contrast and the page_verify a11y count; runs over every compare page on the beat; a planted contrast defect turns it RED
Authored effort: 1. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R2 — Network interception and mocking
Prerequisites: R0 (acceptance unverified)
Contract:
nm_routeAcceptance: Route rules intercept and stub requests in the driven page; a journey runs against a mocked backend deterministically
Authored effort: 1.5. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R6 — Record and codegen
Prerequisites: R1 (acceptance unverified)
Contract:
tc_recordAcceptance: User actions recorded through the driver emit a replayable journey script; replay is byte-equal to the recording on the same build
Authored effort: 2. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R7 — Visual self-healing locators
Prerequisites: R1 (acceptance unverified)
Contract:
va_healAcceptance: A learned visual matcher re-finds a moved element and the healed locator is reported with its evidence; precision on a banked layout-drift set PRE-DECLARED
Authored effort: 3. Executor kind: Local model. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R8 — Cross-browser grid on the swarm
Prerequisites: R0 (acceptance unverified)
Contract:
tg_runAcceptance: Journeys fan out over the mesh to Chromium, Firefox and the sovereign browser; a matrix of results with every cell a link
Authored effort: 2. Executor kind: Organ. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.R9 — LLM test authoring and triage
Prerequisites: R1 (acceptance unverified)
Contract:
lt_authorAcceptance: The sovereign seat drafts journeys from a page and triages failures by seed and frame; every draft runs before it is admitted
Authored effort: 2. Executor kind: Local model. Responsible, accountable and verifier not established. Inspect retained worklog.
Runtime observation: UNKNOWN; outcome UNKNOWN; observed epoch -1. Declared owner: . Receipt
, SHA-256. Identity-bound observation is not accepted completion. Qualification and deployment remain unverified by this projection.
Learning and practice paths
No structured learning path is declared for this plan. Existing research, roadmap and worklog remain available above.
Rung dossiers — every record that bears on a rung, in one place
nx_swcompare_evidence racing writes it beside its stamp); every gate below reads UNRECORDED until it runs.knowledge/organ_gate.conf read from this working directory (1 rows) and from the estate root (196 rows); rows in both counted once: 0; declarations read: 197. Every declaration in either copy counts, so a stub beside the publisher can never hide the root.R0 Sovereign browser driver (CDP and the Nishi browser) · cell WATCHING · gate NO-GATE-DECLARED
| Contract | wd_session · executor Organ · 3 u · stands on nothing |
|---|---|
| Definition of done | An organ drives a real page -- navigate, click, type, wait, screenshot -- over CDP to Chromium and natively to the sovereign browser; the laptop-side nx_cdp.ps1 wire that proved WebGPU is the break-glass precedent this rung retires into an organ |
| Matrix cell | Real-browser WebDriver / CDP driver · runtime/nx_webdriver.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_webdriver; declare nx_webdriver TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R1 Locator API with auto-wait · cell WATCHING · gate NO-GATE-DECLARED
| Contract | e2e_locate · executor Organ · 2 u · stands on R0 |
|---|---|
| Definition of done | Role, text and CSS locators with auto-wait semantics over the driver; a scripted journey on /compare and /survey runs green and a planted DOM change fails it |
| Matrix cell | Selector-based E2E scripting API · runtime/nx_e2e_api.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_e2e_api; declare nx_e2e_api TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R3 Flaky detection and quarantine · cell WATCHING · gate NO-GATE-DECLARED
| Contract | fl_quarantine · executor Organ · 1 u · stands on nothing |
|---|---|
| Definition of done | Re-run statistics over the gate roster journal name flaky gates by measurement; quarantined gates still run and report, they stop blocking; the list is printed, never a count alone |
| Matrix cell | Flaky-test detection and quarantine · runtime/nx_flaky.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_flaky; declare nx_flaky TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R4 CI reports from the gate journals · cell WATCHING · gate NO-GATE-DECLARED
| Contract | tr_report · executor Organ · 1 u · stands on nothing |
|---|---|
| Definition of done | JUnit-class XML plus a per-run page derived from gateroster.jrnl and biteall.log; every row links to its gate and seed |
| Matrix cell | CI reporting and dashboards · runtime/nx_test_report.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_test_report; declare nx_test_report TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R5 Accessibility audit organ · cell WATCHING · gate NO-GATE-DECLARED
| Contract | aa_audit · executor Organ · 1 u · stands on nothing |
|---|---|
| Definition of done | One axe-class report per page composing nx_uiq_atree, nx_uiq_contrast and the page_verify a11y count; runs over every compare page on the beat; a planted contrast defect turns it RED |
| Matrix cell | Accessibility auto-audit · runtime/nx_a11y_audit.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_a11y_audit; declare nx_a11y_audit TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R2 Network interception and mocking · cell WATCHING · gate NO-GATE-DECLARED
| Contract | nm_route · executor Organ · 1.5 u · stands on R0 |
|---|---|
| Definition of done | Route rules intercept and stub requests in the driven page; a journey runs against a mocked backend deterministically |
| Matrix cell | Network interception and mocking · runtime/nx_net_mock.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_net_mock; declare nx_net_mock TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R6 Record and codegen · cell WATCHING · gate NO-GATE-DECLARED
| Contract | tc_record · executor Organ · 2 u · stands on R1 |
|---|---|
| Definition of done | User actions recorded through the driver emit a replayable journey script; replay is byte-equal to the recording on the same build |
| Matrix cell | Auto-record test codegen · runtime/nx_test_codegen.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_test_codegen; declare nx_test_codegen TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R7 Visual self-healing locators · cell WATCHING · gate NO-GATE-DECLARED
| Contract | va_heal · executor Local model · 3 u · stands on R1 |
|---|---|
| Definition of done | A learned visual matcher re-finds a moved element and the healed locator is reported with its evidence; precision on a banked layout-drift set PRE-DECLARED |
| Matrix cell | Visual-AI self-healing selectors · runtime/nx_visual_ai.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_visual_ai; declare nx_visual_ai TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R8 Cross-browser grid on the swarm · cell WATCHING · gate NO-GATE-DECLARED
| Contract | tg_run · executor Organ · 2 u · stands on R0 |
|---|---|
| Definition of done | Journeys fan out over the mesh to Chromium, Firefox and the sovereign browser; a matrix of results with every cell a link |
| Matrix cell | Cross-browser cloud test grid · runtime/nx_test_grid.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_test_grid; declare nx_test_grid TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
R9 LLM test authoring and triage · cell WATCHING · gate NO-GATE-DECLARED
| Contract | lt_author · executor Local model · 2 u · stands on R1 |
|---|---|
| Definition of done | The sovereign seat drafts journeys from a page and triages failures by seed and frame; every draft runs before it is admitted |
| Matrix cell | LLM-driven test authoring and triage · runtime/nx_llm_test.nx · WATCHING decl |
| Gate | NO-GATE-DECLARED — knowledge/organ_gate.conf carries no row for nx_llm_test; declare nx_llm_test TAB <gate> and the ship loop proves it and the verdict lands here. |
| Work log | no log row names this rung yet |
dossiers=10 cells_joined=10 no_matrix_row=0 (sum 10) gates_recorded=0 gates_unrecorded=0 no_gate_declared=10 (sum 10 of cells_joined) evgates=UNSTAMPED
Capability comparisons
Compare the field, search individual capabilities and open their source and adoption evidence. Documented presence does not establish comparative quality.
Position map — centrality and distinctiveness
The four-quadrant map the field uses for brand strategy (Dawar and Bagga, HBR June 2015), re-derived from this matrix on every publish. Centrality is the share of the category's feature mass a player covers, each feature weighted by how many hold it; distinctiveness is the average lead over each rival on the rows the player holds; breadth is the depth-weighted share of the whole matrix (the bubble); depth is how deeply the rows held are held; momentum is the day-over-day move off the spine (green rising, red falling, grey until day two); the dashed path runs first day → previous day → today. Dividers are the category means. Axes are fitted to the field of play, so read the tick numerals, not the frame. Rival marks are documented presence, so a rival's position reads the record, never its quality. The picture grades its own readability below; the table beside it is the same data for a screen reader or a second method.
knowledge/compare/racing.cdmap (cut|x|y, cube|x|y|z); absent = the HBR defaultsbubble area = breadth · ring = momentum (green rising, red falling, grey until day two) · dashed = category means · axes fitted to the field of play: centrality 300–1000, distinctiveness 250–600 of 0–1000 permil (the full range put every player in one corner)
readability of the 2D cut, self-graded by the layout ruler: label overlaps 0 · labels over marks 0 · off-canvas 0 · unresolved labels 0 · mark overlaps 1 (a fact of the data: two players that close are that close) · data spread 669 permil of the plot · quadrant words unseated 0
text contrast, measured with wcag2-ratio (floors from contrast.conf), light theme: labels 16.24 (floor 4.50) · notes 16.24 (floor 4.50) · quadrant words 5.89 (floor 4.50) · tick numerals 5.89 (floor 4.50) · axis titles 5.59 (floor 4.50) · dark theme: labels 13.78 (floor 4.50) · quadrant words 5.55 (floor 4.50) · axis titles 5.97 (floor 4.50) · dark classes under their floor 0 (one figure serves both themes: a dark shortfall is a token to fix, never a class to hide) · classes refused under their floor 0 (a refused class is not drawn; the scale classes are measured, never hidden) · export: SVG PNG (receipt, rendered by the estate's own rasteriser from this page)
readability of the 3D cube, self-graded by the layout ruler: label overlaps 0 · labels over marks 0 · off-canvas 1 · unresolved labels 0 · mark overlaps 1 (a fact of the data: two players that close are that close) · data spread 434 permil of the plot
10 panels over 5 registered axes, every pair once (the lower axis on x, the higher on y) · each panel fitted to its own field of play, first and last tick numerals shown · no labels in a small cut, the legend names the colours; the grade below reports the mark terms only (MM summed over the panels, spread averaged)
readability of the small multiples, self-graded by the layout ruler: label overlaps 0 · labels over marks 0 · off-canvas 0 · unresolved labels 0 · mark overlaps 6 (a fact of the data: two players that close are that close) · data spread 514 permil of the plot
| Player | Quadrant | centrality | distinctiveness | breadth | depth | momentum | Rows held | Days on spine | First seen |
|---|---|---|---|---|---|---|---|---|---|
| Nishi | Unconventional | 410 | 533 | 366 | 733 | 0 since 2026-09-23 | 10 | 10 | 2026-09-15 |
| Playwright | Mainstream | 875 | 297 | 433 | 619 | 0 since 2026-09-23 | 14 | 10 | 2026-09-15 |
| Cypress | Mainstream | 875 | 357 | 483 | 690 | 0 since 2026-09-23 | 14 | 10 | 2026-09-15 |
| Selenium | Peripheral | 589 | 324 | 300 | 666 | 0 since 2026-09-23 | 9 | 10 | 2026-09-15 |
| Applitools | Peripheral | 571 | 324 | 283 | 629 | 0 since 2026-09-23 | 9 | 10 | 2026-09-15 |
| Day | Matrix rows reviewed | Players recorded |
|---|---|---|
| 2026-09-15 | 20 | 5 |
| 2026-09-16 | 20 | 5 |
| 2026-09-17 | 20 | 5 |
| 2026-09-18 | 20 | 5 |
| 2026-09-19 | 20 | 5 |
| 2026-09-20 | 20 | 5 |
| 2026-09-21 | 20 | 5 |
| 2026-09-22 | 20 | 5 |
| 2026-09-23 | 20 | 5 |
| 2026-10-08 | 20 | 5 |
players 5|matrix rows 20|feature mass 56|centrality mean 664|distinctiveness mean 367|axes 5|spine days 10 (shown 10)|rows written today 0|readability defects 2D 0 cube 1|spine knowledge/status/cdmap/racing.spine
Capability matrix — measured against source
◉ authored stronger claim; source present● present◐ partial○ absent? unassessed; excluded from relative comparison · click any capability for its evidence
Peer cell coverage: authored assessed 80, unassessed 0. Authored assessments are not verified outcomes.
No capabilities match this filter or search.
| Capability | Nishi | Playwright | Cypress | Selenium | Applitools |
|---|---|---|---|---|---|
Vision forensics on the SHIPPED artifact (not source, not a proxy)Measured:abug exists in runtime/_hdl_build/nx_mineworld_autotest.nx, verified at emit. Executes the real wasm on nx_wasm_vm and reads the framebuffer: blackout/frozen/magenta-leak/sky-ground structure; Applitools does screenshot AI-diff, but on browser captures not on the shipped bytes in our own VM rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind them Adoption: SOURCE-ONLY — PARTIAL: source exists, never compiled: /api/build it.Pros Implementing source symbol found; runtime acceptance separate; ahead of Selenium, ApplitoolsCons not adopted yet: source exists, never compiled: /api/build it | ● | ● | ● | ○ | ◐ |
Seeded-repro fuzz determinism (any red = exact repro)Measured:abug exists in runtime/_hdl_build/nx_mineworld_autotest.nx, verified at emit. LCG seed printed in every finding; frames 1-6 byte-identical across runs; the loop auto-found + localized 2 miscalibrations on runs 1 and 2 (2026-07-03) rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind them Adoption: SOURCE-ONLY — PARTIAL: source exists, never compiled: /api/build it.Pros Implementing source symbol found; runtime acceptance separate; ahead of ApplitoolsCons not adopted yet: source exists, never compiled: /api/build it | ● | ● | ● | ● | ○ |
No-reference perceptual image-quality judgeMeasured:ns_mscn_rho exists in runtime/nx_natstat.nx, verified at emit. MSCN / NIQE-class 5-axis natural-scene statistics (reverse-AI photoreal judge) [niqe13]; Applitools visual AI leads on learned diff Adoption: LIB-WIRED importers=9 nonval=5 — fully adopted (top of its ladder).Pros Implementing source symbol found; runtime acceptance separate; ahead of Playwright, Cypress, Selenium; fully adopted on the estate ladderCons behind Applitools (leads) | ● | ○ | ○ | ○ | ◉ |
State invariants per tickMeasured:abug exists in runtime/_hdl_build/nx_mineworld_autotest.nx, verified at emit. camera-y bounds + pitch-clamp checked every tick, not just at frame samples rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind them Adoption: SOURCE-ONLY — PARTIAL: source exists, never compiled: /api/build it.Pros Implementing source symbol found; runtime acceptance separate; ahead of ApplitoolsCons not adopted yet: source exists, never compiled: /api/build it | ● | ● | ● | ● | ○ |
Competitive-intel delta ledger (survey incumbents, drive roadmap)Measured:nx_cint_record exists in runtime/nx_competitive_intel.nx, verified at emit. Per-incumbent delta ledger with a 90-day survey cadence and next-due tracking (nx_cint_record/set_next_due); no test tool ships strategic competitive-intel as a primitive Adoption: SOURCE-ONLY — PARTIAL: source exists, never compiled: /api/build it.Pros Implementing source symbol found; runtime acceptance separate; ahead of Playwright, Cypress, Selenium, ApplitoolsCons not adopted yet: source exists, never compiled: /api/build it | ● | ○ | ○ | ○ | ○ |
Measured pitwall board (1:1 no-proxy)Measured:nx_pitwall_stage exists in runtime/nx_pitwall_render.nx, verified at emit. The racing-crew scoreboard: measured position vs named incumbents, no proxy (nxasm 4x/size/determinism triple-exceed found + gated 2026-05-29) Adoption: LIB-GATE-ONLY importers=1 — PARTIAL: imported only by validation organs (gates, tests, benches): wire it into a shipping program.Pros Implementing source symbol found; runtime acceptance separate; ahead of Playwright, Cypress, Selenium, ApplitoolsCons not adopted yet: imported only by validation organs (gates, tests, benches): wire it into a shipping program | ● | ○ | ○ | ○ | ○ |
Liar-killed competitive census planeMeasured:LIAR-KILL exists in runtime/nx_swcompare_matrix.nx, verified at emit. 32 live head-to-head comparisons; every Nishi cell requires the symbol on disk, fabricated cells die at build -- the racing crew's find-gaps-vs-competitors engine, productized Adoption: RUN-BY:fork:nx_compare_regen — fully adopted (top of its ladder).Pros Implementing source symbol found; runtime acceptance separate; ahead of Playwright, Cypress, Selenium, Applitools; fully adopted on the estate ladderCons none on the measured axes (rival marks are documented presence, not depth) | ● | ○ | ○ | ○ | ○ |
UX / UI composition gradingMeasured:pmil exists in runtime/nx_ui_judge.nx, verified at emit. nx_ui_judge scores contrast/tokens/mobile; the field pairs with axe/Lighthouse, Applitools does visual UI diff rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind them Adoption: REGISTERED-UNAUTHORISED — PARTIAL: registered, no cap ever minted; no execution surface runs it either (clock, cron, daemon, roster, actlog and surfaced forks checked).Pros Implementing source symbol found; runtime acceptance separate; ahead of Selenium, ApplitoolsCons not adopted yet: registered, no cap ever minted; no execution surface runs it either (clock, cron, daemon, roster, actlog and surfaced forks checked) | ● | ● | ● | ○ | ◐ |
Real-browser WebDriver / CDP driverOpen — watchingruntime/nx_webdriver.nx : wd_session, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Playwright CDP [cdp] + Selenium WebDriver [w3c-webdriver] are the bar; our harness runs wasm directly, the JS/canvas/DOM layer is outside it by construction -- the named next rungPros none measured yetCons behind Playwright (leads), Cypress (leads), Selenium, Applitools; open contract; expected source declaration not established | ○ | ◉ | ◉ | ◐ | ● |
Selector-based E2E scripting APIOpen — watchingruntime/nx_e2e_api.nx : e2e_locate, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Playwright locators + auto-wait are the bar [playwright-autowait]; we fuzz inputs, we do not script user journeysPros none measured yetCons behind Playwright, Cypress (leads), Selenium (leads), Applitools; open contract; expected source declaration not established | ○ | ◐ | ◉ | ◉ | ● |
Visual-AI self-healing selectorsOpen — watchingruntime/nx_visual_ai.nx : va_heal, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Applitools self-healing locators + AI diff are the bar [applitools-eyes]; our vision is heuristic forensics, not a learned modelPros none measured yetCons behind Playwright, Cypress, Applitools; open contract; expected source declaration not established | ○ | ● | ● | ○ | ◐ |
Cross-browser cloud test gridOpen — watchingruntime/nx_test_grid.nx : tg_run, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Selenium Grid + BrowserStack are the bar [selenium-grid]; we run one interpreted VMPros none measured yetCons behind Playwright (leads), Cypress, Selenium, Applitools (leads); open contract; expected source declaration not established | ○ | ◉ | ● | ◐ | ◉ |
Network interception and mockingOpen — watchingruntime/nx_net_mock.nx : nm_route, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Playwright route-mocking is the bar; absent here rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind themPros none measured yetCons behind Playwright, Cypress, Selenium; open contract; expected source declaration not established | ○ | ◐ | ◐ | ● | ○ |
Flaky-test detection and quarantineOpen — watchingruntime/nx_flaky.nx : fl_quarantine, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Every mature suite quarantines flakies [luo14]; ours is deterministic-by-seed so flakiness is structurally rarer, but no detector organ existsPros none measured yetCons behind Playwright, Cypress (leads), Selenium; open contract; expected source declaration not established | ○ | ◐ | ◉ | ● | ○ |
Auto-record test codegenOpen — watchingruntime/nx_test_codegen.nx : tc_record, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. Playwright codegen + Cypress Studio record user actions into tests [cypress-studio]; absent here (ties to the team census macro-recorder gap)Pros none measured yetCons behind Playwright (leads), Cypress, Selenium; open contract; expected source declaration not established | ○ | ◉ | ◐ | ● | ○ |
CI reporting and dashboardsOpen — watchingruntime/nx_test_report.nx : tr_report, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. JUnit/Allure reporting is the field standard; our forensics tables are console + the /compare board, no per-run CI surface rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind themPros none measured yetCons behind Playwright, Cypress, Selenium (leads), Applitools (leads); open contract; expected source declaration not established | ○ | ◐ | ◐ | ◉ | ◉ |
Accessibility auto-auditOpen — watchingruntime/nx_a11y_audit.nx : aa_audit, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. axe-core / Lighthouse a11y are the bar [axe-core]; ties to the UI-quality doctrine but no automated a11y organPros none measured yetCons behind Playwright, Cypress; open contract; expected source declaration not established | ○ | ● | ● | ○ | ○ |
LLM-driven test authoring and triageOpen — watchingruntime/nx_llm_test.nx : lt_author, re-measured on every compare beat. Ship that symbol and this mark flips itself; the comparewatch- plane row flips with it. The cross-roster convergence gap (5th radar to point here); nobody in this field fully ships it either rival marks uncited — the Yes, Best or Part codes on this row are an observation read with no reference mark behind themPros none measured yetCons behind Playwright, Cypress (leads), Applitools; open contract; expected source declaration not established | ○ | ◐ | ◉ | ○ | ◐ |
Tests the shipped bytes on our own VM (sovereign, no external browser)Source present; authored stronger claim:abug in runtime/_hdl_build/nx_mineworld_autotest.nx, verified at emit. The harness executes the ACTUAL deployed wasm in nx_wasm_vm and inspects VM memory + framebuffer host-side -- zero external browser, zero proxy, bit-exact; the field drives a real browser it does not own Adoption: SOURCE-ONLY — PARTIAL: source exists, never compiled: /api/build it.Pros Source symbol found; stronger capability claim is authored; ahead of Playwright, Cypress, Selenium, ApplitoolsCons not adopted yet: source exists, never compiled: /api/build it | ◉ | ○ | ○ | ○ | ○ |
Survey-incumbents-and-drive-the-roadmap as a standing primitiveSource present; authored stronger claim:nx_cint_record in runtime/nx_competitive_intel.nx, verified at emit. The racing doctrine is a compiled ledger + cadence + pitwall + the 32-comparison plane: honest delta-to-incumbent drives every roadmap; the test-automation field ships no strategic competitive-intel layer Adoption: SOURCE-ONLY — PARTIAL: source exists, never compiled: /api/build it.Pros Source symbol found; stronger capability claim is authored; ahead of Playwright, Cypress, Selenium, ApplitoolsCons not adopted yet: source exists, never compiled: /api/build it | ◉ | ○ | ○ | ○ | ○ |
| Class | Count | Note |
|---|---|---|
| rows with rival marks | 15 | rows carrying a Yes, Best or Part in a rival column |
| cited | 8 | a reference mark resolves to a pinned mirror |
| uncited | 7 | an observation read, badged until a reference lands |
| rows, summed | 15 | RECONCILED: the parts sum to the total 15 |
Delivery and evidence
Inspect risks, technical debt, rendered observations, experiments and references. Read scope and limitations alongside every result.
Person · product · place — not yet measured for this domain
knowledge/compare/racing.ppp (rows surface|nishi or c1..c4|label|url|connect naming OUR live surface and each rival's front door), run nx_ppp_probe domain racing, and this section fills itself on the next beat: the same ruler on both sides — privacy and CX (third-party hosts, tracker classes, cookies, security headers), design and longevity (design hygiene, computed WCAG contrast, render-blocking resources, unsized media, script weight, theme and motion queries), findability (landmarks, skip link, on-site search, breadcrumb, headings, internal links).The field — discovered, not chosen
Rows written by nx_field_discover from racing.seeds: the industry's own lists (Wikipedia wikitext, GitHub topics, awesome lists) read mechanically, every candidate counted across seeds. The matrix columns above are a SEAT'S pick; this band is the population they were picked from, and the stats line measures one against the other. A rival here is a lead, never a verdict — it earns a column when its capabilities are read and pinned.
| Class | Count | Note |
|---|---|---|
| seeds | 4 | |
| scanned | 4 | |
| fetched | 4 | |
| reused | 0 | |
| failed | 0 | |
| named | 4 | |
| candidates | 4 | |
| mentions | 4 | |
| capped | 0 |
| Rank | Rival | Seeds | Mentions | First seed | Kind | Link |
|---|---|---|---|---|---|---|
| 1 | Playwright | 1 | 1 | col0-playwright | named | https://playwright.dev/docs/actionability |
| 2 | Cypress | 1 | 1 | col1-cypress | named | https://docs.cypress.io/app/guides/cypress-studio |
| 3 | Selenium | 1 | 1 | col2-selenium | named | https://www.selenium.dev/documentation/grid/ |
| 4 | Applitools | 1 | 1 | col3-applitools | named | https://applitools.com/docs/ |
field candidates 4|shown 4 of 4|matrix columns in the field 4 of 4|discovered rivals with no column 0|malformed rows 0 (counted, never rendered)|read-capped 0
Exclusive and shared capabilities
This board grades 16 capabilities: 13 exclusive to it and 3 shared with other boards. Shared rows on this page: 3 = home here 0 + home elsewhere 0 + ambiguous 0 + undecided 3 + refused 0 (partition 3); undecided = unmapped 0 + unproven 3 + unevidenced 0; homonyms 1; since the previous census: new 0, resolved 0. Census FRESH age_s=6512.
| Capability | Organ | Boards grading it | Home | Rule | Evidence | Standing on this board |
|---|---|---|---|---|---|---|
| ns_mscn_rho | nx_natstat.nx | videoops, racing | — | none | unproven | undecided |
| abug | nx_mineworld_autotest.nx | racing, gameengine | — | none | unproven | undecided |
| LIAR-KILL | nx_swcompare_matrix.nx | racing, referee | — | none | unproven | undecided |
| tr_report | - | racing:runtime/nx_test_report.nx, engineshift:runtime/_hdl_build/nx_tokroi.nx | — | homonym | - | homonym |
Gaps from the record — what the estate does that no board carries
The record census (nx_goalmap record) reads the invoked-tool population and every plan queue row and files each organ or directive that NO matrix, plan or gates row names. A row here is a callout the boards missed: adjudicate it onto a board or declare it infrastructure. Census state STALE (age 1395617 s), sources read 4 of 7 declared — a BLIND census is a FLOOR: unread sources can only add rows.
| kind | name | board | source | evidence |
|---|
rows shown 0|this board's directives 0|estate-wide un-boarded organs 452 (listed in full on /compare/ecosystem)|census rows 639|malformed 0 (counted, never rendered)
References
- [playwright-autowait] Microsoft. Playwright documentation, Auto-waiting: actionability checks (visible, stable, receives events, enabled, editable) run before every locator action, failing with TimeoutError instead of flaking. publisher · read in our library
knowledge/fetched/cmp_racing_playwright-autowait.html· pinhad67cb07cdb4baaf7b3a553bd4c6a64219114e937a78ad3444a2ec213a81f32a· accessed 2026-08-18 · vendor-docGrounds: The Playwright column: "Selector-based E2E scripting API" (the row's "Playwright locators + auto-wait are the bar") and "Real-browser WebDriver / CDP driver" (Playwright CDP) -- the documented behaviour our absent nx_e2e_api and nx_webdriver are graded against. - [cypress-studio] Cypress.io. Cypress Studio (Cypress Documentation): record clicks, typing and form interactions in the running app into Cypress test code, with AI-suggested assertions reviewed before saving. publisher · read in our library
knowledge/fetched/cmp_racing_cypress-studio.html· pinhc67cd97e9b99a894146f3355d6711dd8fbf55f6d8cbcff6195237f99bab05140· accessed 2026-08-18 · vendor-docGrounds: The Cypress column: "Auto-record test codegen" (the row's "Playwright codegen + Cypress Studio record user actions into tests") -- the recorder our nx_test_codegen is _ABSENT_ against, and the tie to the team census macro-recorder gap. - [selenium-grid] Selenium project. Selenium Grid documentation: WebDriver scripts executed on remote machines by routing client commands to remote browser instances -- parallel runs across many machines, browser versions and operating systems. publisher · read in our library
knowledge/fetched/cmp_racing_selenium-grid.html· pinh51f2d209d9994c6ac5fb133b847782ebdf5bf888d5632a539186991dec505254· accessed 2026-08-18 · vendor-docGrounds: The Selenium column: "Cross-browser cloud test grid" (the row's "Selenium Grid + BrowserStack are the bar") -- distributed multi-browser execution versus our single interpreted VM. - [w3c-webdriver] W3C. WebDriver. W3C Recommendation, 05 June 2018 -- "a remote control interface that enables introspection and control of user agents"; the wire protocol Selenium implements (WebDriver Level 2 continues as a Working Draft, 02 July 2026). publisher · accessed 2026-08-18 · published-standardGrounds: "Real-browser WebDriver / CDP driver" -- the row's "Selenium WebDriver" bar is this standard; a sovereign driver speaking it is the named next rung. Mirror absent by declaration: the sovereign fetch of w3.org returned a 5.8KB truncated body.
- [cdp] Chrome DevTools team (Google). Chrome DevTools Protocol: the domains, methods and events that let tools instrument, inspect, debug and profile Chromium-based browsers -- the protocol Playwright and Puppeteer drive. publisher · read in our library
knowledge/fetched/cmp_racing_cdp.html· pinhf4119c5a11315df0f83d4968bd77b0a5539408f527a2c1aa9d75ef481c40cd02· accessed 2026-08-18 · vendor-docGrounds: "Real-browser WebDriver / CDP driver" -- the CDP half of the row's "Playwright CDP + Selenium WebDriver are the bar"; the JS/canvas/DOM layer our wasm harness cannot reach is exactly what this protocol exposes. - [applitools-eyes] Applitools. Applitools Documentation: Eyes Visual AI added to an existing test framework, the Ultrafast Grid for cross-browser visual runs, and the Execution Cloud whose self-healing lets tests run even when elements have changed. publisher · read in our library
knowledge/fetched/cmp_racing_applitools.html· pinh226005936c94ab2229ea8aac907eb46988ad57adf9c99129da51171668407507· accessed 2026-08-18 · vendor-docGrounds: The Applitools column: "Visual-AI self-healing selectors" (the row's "Applitools self-healing locators + AI diff are the bar"), "Vision forensics on the SHIPPED artifact" (Applitools screenshot AI-diff on browser captures, code 3) and "UX / UI composition grading" -- learned visual diff versus our heuristic framebuffer forensics. - [niqe13] Mittal, Soundararajan, Bovik. Making a Completely Blind Image Quality Analyzer (NIQE). IEEE Signal Processing Letters, pp. 209-212, March 2013; with Mittal, Moorthy, Bovik, No-Reference Image Quality Assessment in the Spatial Domain (BRISQUE), IEEE TIP 2012 -- both listed on the LIVE lab no-reference IQA page. publisher · read in our library
knowledge/fetched/cmp_racing_niqe13.html· pinhff89949bea4a7961618db4a8fb32f153aeaac5566a3ee3f9243df4f42fc735b0· accessed 2026-08-18 · published-paperGrounds: "No-reference perceptual image-quality judge" -- the row's "MSCN / NIQE-class 5-axis natural-scene statistics": MSCN coefficients and the NIQE natural-scene-statistics model are these papers, the published basis of nx_natstat ns_mscn_rho. - [axe-core] Deque Systems. axe-core: the accessibility engine for automated Web UI testing (GitHub repository and rule documentation). publisher · read in our library
knowledge/fetched/cmp_racing_axe-core.html· pinh2ae56ef394658f8192bb22cc56f617bd0ec0189d7acef4596514e961be6db6af· accessed 2026-08-18 · vendor-docGrounds: "Accessibility auto-audit" -- the row's "axe-core / Lighthouse a11y are the bar"; the rule engine our absent nx_a11y_audit is graded against, tied to the UI-quality doctrine. - [luo14] Luo, Hariri, Eloussi, Marinov. An Empirical Analysis of Flaky Tests. FSE 2014 (22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering), pp. 643-653 -- 201 flaky-fix commits across 51 projects, root-cause taxonomy and fix strategies. publisher · read in our library
knowledge/fetched/cmp_racing_luo14.pdf· pinh36abbab3e917ad38300e8956a0311004423e4dcfede766b1bf6081b02fe1823b· accessed 2026-08-18 · published-paperGrounds: "Flaky-test detection and quarantine" -- the published root-cause taxonomy (async waits, concurrency, test-order dependence) behind why every mature suite quarantines flakies; our seed-deterministic harness makes the class structurally rarer, but no detector organ exists.
generated by nx_swcompare_matrix (sovereign NishiLang organ) from knowledge/compare/racing.matrix · source checks show implementation presence; runtime and user-outcome evidence are reported separately · JavaScript supports page controls