Repository navigation
plans: scratch mindmap for NaN exclusion in masked statistics - #379
Conversation
Purposes (missing value, computation error, replay, audit, cost) against the payoffs of each NaN policy and float carrier, read as a small game: the dilution policies are locally cheapest and never best on any purpose. Design moves that change the payoffs, a determinism ladder, candidate steps and open questions. Nothing is built or decided. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XAqKMPh2Seh2WLccCksAdY
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars.
|
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
The /5plus3 premise gate found that 'NaN' names two concepts (missing value, whose home is lance-graph Quack's binder-owned validity plane, and a computation error), and 'determinism' names two properties (D-WFL-DET's mask determinism vs float-fold determinism). Dilution is already impossible in power_sums_fold: n and sum are incremented in one closure per selected row. Council halted before Phase 1; three re-asked questions recorded with owners. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XAqKMPh2Seh2WLccCksAdY
One scratch document, for later examination:
.claude/plans/nan-exclusion-mindmap-scratch.md. No code; nothing in it is built, measured or decided.It is a follow-up to #378. A masked statistic (n, mean, variance) can meet a NaN, and the failure to avoid is dilution: the sums and the sample count stop describing the same rows, with no signal that it happened.
The document contains:
n_excluded;(n, mean, M2), against compensated sums.mul_addis done (simd: mul_add rounds once on every backend (wasm emulation, exact scalar FMA, no libm) #374/simd(wasm): certify the F64x8::mul_add domain, keep exact-product lanes in the vector #378); a fixed summation order and a fixed merge tree are still open.Generated by Claude Code