code wiki / (root) / nx_dr_drbench.nx

nx_dr_drbench.nx

buildroot/runtime/nx_dr_drbench.nx

2255 B49 linesdepth 2pulls 2 transitivereach 4 importersview sourcekind benchtopic dr
docsdependenciesstructsconstsfunctions

about

nx_dr_drbench.nx -- SOVEREIGN DRBench + DEER deep-research SCORER / ruler (DR-0). Measurement-first: you cannot honestly claim "exceed Google" without the number. Implements the metrics the field actually scores, deterministically + integer-exact: DRBench (ServiceNow, arXiv:2510.00172): Insight Recall (THE binding constraint -- best system 36.5%, GPT-4o 13.2%), Distractor Avoidance (>93% everywhere = easy), Factuality (cited-claim support). DEER (LG AI, arXiv:2512.17776): Request Completeness + Evidence Validity (the two weak spots of every current agent), via back-tracking of cited AND uncited claims. The SCORER is sovereign/deterministic; the MATCHING (does a report insight match a groundtruth insight) is the separate judge stage (lexical/PPMI now via recall lane, no-float LLM escalation later) -- this organ takes the per-item match flags, exactly as nx_recall_eval takes graded gains. Imports ONLY nx_syscalls = drift-immune. No hardware writes (Rule 26). module: nishi-core.research.dr_drbench depends: nx_syscalls.nx genealogy_id: drbench_2026_servicenow + deer_2026_lgai NOTE: DISTINCT from nx_drbench.nx (a HotpotQA multi-hop QA harness) -- eats seq225.

dependencies 1 imports · 4 importers

nx_syscalls.nx nx_dr_drbench.nx nx_dr_chain_cli.nx nx_dr_corpus_cli.nx nx_dr_drbench_cli.nx nx_dr_run_cli.nx

imports: nx_syscalls.nx

imported by: nx_dr_chain_cli.nxnx_dr_corpus_cli.nxnx_dr_drbench_cli.nxnx_dr_run_cli.nx

structs

none

consts

none

functions

22func dr_sum(a: *i64, n: i64) -> i64
called by 2: dr_fracdr_avoidance
30func dr_frac(a: *i64, n: i64) -> i64
called by 4: mainmainmainmain calls 1: dr_sum
38func dr_avoidance(included: *i64, n: i64) -> i64
called by 1: main calls 1: dr_sum
44func dr_mean(vals: *i64, k: i64) -> i64
called by 1: main