diff --git a/.arxiv/2210.07278_meta_uncertainty_bayesian_model_comparison_vs_ce64_mul.md b/.arxiv/2210.07278_meta_uncertainty_bayesian_model_comparison_vs_ce64_mul.md new file mode 100644 index 000000000..49b89d52d --- /dev/null +++ b/.arxiv/2210.07278_meta_uncertainty_bayesian_model_comparison_vs_ce64_mul.md @@ -0,0 +1,46 @@ +# Meta-uncertainty in Bayesian model comparison: distinct from CE64 MUL + +**Source:** Marvin Schmitt, Stefan T. Radev, Paul-Christian Bürkner, *Meta-Uncertainty in Bayesian Model Comparison*, AISTATS 2023 / PMLR 206. +**Paper:** https://arxiv.org/abs/2210.07278 · [PDF](https://arxiv.org/pdf/2210.07278) (arXiv v3, 2023-02-21). +**Read status:** Focused read of abstract, §§2–3.5, Proposition 2, minimum example and the overview of limitations; NOT an exhaustive reproducibility review. +**Date:** 2026-10-19. +**Repo owner:** `AdaWorldAPI/lance-graph` research notes. **No implementation claimed.** + +## Source-derived claim + +Bayesian model comparison gives posterior model probabilities (PMPs) `π_j = p(M_j | y)` over a **specified candidate model set**. A PMP close to 1 is not by itself a guarantee that repeating the experiment will lead to the same model preference. The authors introduce a distribution *over possible future PMP vectors* by simulating data under candidate models, fitting meta-models to the model-implied PMP distributions, and combining their posterior predictives into a data-informed mixture. Its purpose is to assess replicability and mitigate spuriously strong model preference under the assumptions of the candidate models. + +The paper distinguishes **three levels**, not three grades of subjective confidence: + +1. **Level 1:** uncertainty in the PMP vector for a finite observed dataset. +2. **Level 2:** variability of model-implied PMP vectors across replicated/simulated datasets under the same generating model. +3. **Level 3:** uncertainty about the fitted meta-model's distribution of PMPs, owing to a finite number of simulations `K`. + +The key construction in §3.3, Eq. (8), is a posterior predictive **mixture distribution for future PMP vectors**, weighted by observed PMPs; it is not simply a new direct posterior for model truth. Proposition 2 states non-vanishing predictive variance under the stated model-mixture conditions even when observed PMPs concentrate on one model. + +**Source example (§3.5):** For an atypical sample in a two-model Beta–Binomial comparison, an observed PMP is roughly `0.999`; the paper reports a predictive-mixture **mean** of roughly `0.55`. This is an illustration of model-comparison instability, **not** a universal confidence correction or a claim that `p(M_1|y)=0.55`. + +**Caveat:** Closed candidate sets and prior-predictive simulation can be misspecified. The paper's guarantees do not prove that every true explanation lies in the modeled family or that simulations match real experience. + +## Existing Lance-graph contract boundary + +- `crates/lance-graph-contract/src/epistemic_state5.rs`: CE64 bits **59..63** remain ONE declared product field, **Topology2 × Certification3**, 24 meaningful states and 8 reserved. Never repurpose for calibration probabilities. +- `crates/lance-graph-contract/src/band_reading.rs`: legacy Meta-Uncertainty-Layer `TrustTexture` names (Crystalline/Solid/Fuzzy/Murky) are code-identical aliases for **topology** (Direct/IndirectKnown/IndirectUnknown/Unknown), **not source reliability estimates**. +- NAL `F/C` are evidential frequency/confidence with their own semantics, **not** Bayesian PMPs. +- See `.claude/knowledge/epistemic-frontier-capstone.md`, `.claude/knowledge/ce64-reasoning-substrate-plateau.md`, `.claude/plans/sag-wisdom-frontier-hard-problems-v1.md` for register ownership, provenance and model-misspecification constraints. + +## Potential research transfer (HYPOTHESIS, NOT THE PAPER'S RESULT) + +An **offline, versioned metacognitive evaluation** can compare a finite set of rival inference policies, reasoning styles or causal models, subject to a declared likelihood/generative model. Store a separate audit receipt keyed by a stable thought version, model-family version and independently grounded data provenance: + +- Observed distribution of support for competing models or strategies. +- Distribution of outputs expected from replication on synthetic/held-out cases. +- Simulation/sample counts and uncertainty in the replication estimate. +- Agreement/disagreement with independent outcomes; out-of-family discrepancy gate. +- Choice of next observation or abstention, with explicit limitations. + +Do **not** treat 64 thought slots as independent evidence, the CE64 `Certification3` ordinal as a probability, or duplicated Narsese/MeTTa/Datalog derivations as repeated independent model observations. + +**First falsification probe:** A model reports near-certain preference in one small dataset, but repeated held-out datasets reverse it. Compare baseline certainty-only selection against explicit predictive-variability assessment at matched compute. Include (a) identical duplicated evidence, (b) an out-of-model generating process, (c) large-sample convergence, and (d) variance due only to estimator simulation count. A good guard must expose instability without claiming the candidate set is complete. + +**Scope:** Research note only; no bitfield, source file, recipe or production ABI changed. diff --git a/.arxiv/2310.18318v1_opencog_hyperon_100_page_reading_bookmark.md b/.arxiv/2310.18318v1_opencog_hyperon_100_page_reading_bookmark.md new file mode 100644 index 000000000..540881dcb --- /dev/null +++ b/.arxiv/2310.18318v1_opencog_hyperon_100_page_reading_bookmark.md @@ -0,0 +1,30 @@ +# READ LATER: OpenCog Hyperon (100-page background and introduction) + +**Title:** *OpenCog Hyperon: A Framework for AGI at the Human Level and Beyond – High-Level Background & Introduction* +**Primary author:** Ben Goertzel; with Vitaly Bogdanov, Michael Duncan, Deborah Duong, Zarathustra Goertzel, Jan Horlings, Matthew Ikle', Lucius Greg Meredith, Alexey Potapov, Andre Luiz de Senna, Hedra Seid, Andres Suarez, Adam Vandervorst and Robert Werko. +**Source:** [arXiv:2310.18318v1](https://arxiv.org/abs/2310.18318) · [specific v1 PDF](https://arxiv.org/pdf/2310.18318v1). +**Version:** v1, 2023. **Length:** 100 PDF pages. +**Status:** **READ LATER / BOOKMARK ONLY** (2026-10-19). Do not characterize sections as validated design, implemented code, or conclusions until read. +**Owner:** `AdaWorldAPI/lance-graph/.arxiv`. This note does **not** embed or reproduce the full paper. + +## Why queued + +Primary-source architectural reference for Hyperon/MeTTa/Atomspace, prospective integration with OpenCog systems, metagraph reasoning, cognitive models and reflective self-modification. Related to the Lance-graph research on Narsese/NAL/ONA, RelAlg/Datalog/R2IL, canonical thought identities, 64 active thoughts and semantic Git. **Relevance is prospective, not demonstrated architectural parity.** + +## Reading itinerary (contents headings in PDF, not analysis) + +- §§2–3, pp. 5–42: conception of intelligence; Atomspace and MeTTa; specialized spaces, distribution and architectural infrastructure. +- §4, pp. 43–80: CogPrime cognitive model; episodic, working and procedural memory; reasoning, reinforcement learning, language, multimodal perception, goal refinement, reflexive self-understanding and other minds. +- Later sections: inspect with attention to future roadmap, limitations, self-modification and capability claims. + +## Questions to check when resumed + +1. Which MeTTa/Atomspace constructs are precisely defined versus roadmap statements? +2. Which edges support typed target ports, edge-to-edge or whole-edge references, versus plain SPO? +3. Which rewrite, fold, temporal, evidence and control semantics can be preserved losslessly through the canonical Lance-graph ABI? +4. Which memory, attention, goal and introspection descriptions are genuinely executable rather than conceptual? +5. What parity tests, counterexamples and failure-to-map cases are necessary before an R2IL/Datalog/MeTTa adapter can claim equivalence? + +**Related existing notes:** `.arxiv/2026-10_hyperon_metta_to_lance_graph_parity_map.md` and `.arxiv/2026-10_hyperon_metagraph_folds_chronomorphisms_primary_excerpts.md`. Check those first when continuing to avoid duplicating work. + +**Repository action:** additive bookmark only. No production change, no existing note overwritten or deleted. diff --git a/.arxiv/2409.20212_graph_attributes_structure_matching_gasm_bookmark.md b/.arxiv/2409.20212_graph_attributes_structure_matching_gasm_bookmark.md new file mode 100644 index 000000000..349028627 --- /dev/null +++ b/.arxiv/2409.20212_graph_attributes_structure_matching_gasm_bookmark.md @@ -0,0 +1,22 @@ +# READ LATER: Graph Attributes and Structure Matching (GASM) + +**Author:** Raphaël Candelier. +**Paper:** *Graph matching based on similarities in structure and attributes*. +**Primary source:** [arXiv:2409.20212v1](https://arxiv.org/abs/2409.20212v1) | [PDF](https://arxiv.org/pdf/2409.20212v1), submitted 2024-09-30. +**Status:** ABSTRACT REVIEWED / FULL ALGORITHM DEFERRED. **Archived:** 2026-10-19. + +## Source abstract + +The work proposes **GASM (Graph Attributes and Structure Matching)**, incorporating connectivity and vertex/edge attributes when searching for vertex correspondences between different graphs. It introduces parameters to account for attribute reliability and compares matching quality/timing to baseline graph-matching methods. The abstract reports performance competitive with state-of-the-art methods, including on structure-only problems. + +No proof of a perfect or generally lossless match is claimed here. Empirical results have not been independently replicated in this note. + +## Relevance to the canonical thought address decision + +**Do not apply graph matching where none is needed.** All 64 Lance-graph thoughts share the same 65,536 canonical row addresses in a sealed version: Thought[a][i] and Thought[b][i] already agree on the canonical coordinate. Presence mask intersection and positional folds do not need GASM or a new matching index. + +Potential *external* uses: aligning independently minted ontologies, imported entity graphs, schema families or external datasets whose identities cannot be assumed equal. Attribute reliability may help generate candidates, but exact canonical identity still requires an explicit verified binding and preservation of alternatives. + +**Probe for later:** Two distinct graphs with intentionally ambiguous structure and conflicting attributes; include false-friend identity, partial isomorphism, missing edges, duplicated labels, and low-reliability attributes. Compare to an independent oracle. Never silently merge NodeGuid identities based solely on matching score. + +**Boundary:** Research bookmark only, not evidence that GASM is used or needed in the common-coordinate hot path. diff --git a/.arxiv/2412.01423_semantic_maps_top_down_crosslinguistic_graph_bookmark.md b/.arxiv/2412.01423_semantic_maps_top_down_crosslinguistic_graph_bookmark.md new file mode 100644 index 000000000..f4e5bf7d5 --- /dev/null +++ b/.arxiv/2412.01423_semantic_maps_top_down_crosslinguistic_graph_bookmark.md @@ -0,0 +1,24 @@ +# READ LATER: Top-down crosslinguistic semantic map graphs + +**Authors:** Zhu Liu, Cunliang Kong, Ying Liu, Maosong Sun. +**Paper:** *A Top-down Graph-based Tool for Modeling Classical Semantic Maps: A Crosslinguistic Case Study of Supplementary Adverbs*. +**Primary source:** [arXiv:2412.01423v3](https://arxiv.org/abs/2412.01423v3) | [PDF](https://arxiv.org/pdf/2412.01423v3); v3 2025-03-29, NAACL 2025. +**Status:** ABSTRACT REVIEWED / DETAILED READING DEFERRED. **Archived:** 2026-10-19. + +## Source abstract + +Classical semantic map models represent conceptual relatedness across languages under a **connectivity hypothesis**. The authors propose constructing conceptual spaces from a dense graph and then pruning to **maximum spanning trees**, with intrinsic/extrinsic evaluation criteria that balance structural coverage and precision. Their case study concerns crosslinguistic supplementary adverbs. + +The authors position the method against manually constructed semantic maps. This is not a general formal proof that all meanings in natural language are tree-shaped, nor proof that a tree entails correct grammatical inference. + +## Future Haspelmath / DeepNSM-v2 relevance (hypotheses) + +- Examine whether semantic-map connectivity can provide a **candidate-space constraint** for independently attested role/semantic relations across languages. +- Keep language-specific readings, referential/anaphoric uncertainty, and attestation separate from shared canonical claim identity. +- A spanning tree can lose alternative paths or polysemy; preserve such alternatives before any graph reduction. +- Test multiple grammatical orientations over a four-sentence anaphoric ring against the **same justified canonical conclusions**, not merely aesthetically similar layouts. +- Do not confuse the paper's crosslinguistic semantic maps with an executable RelAlg/Datalog AST, CE64 role, Haspelmath grammar ABI, or a verified semantic crosswalk. + +Relevant archived work: [Haspelmath DeepNSM harness](2026-10_haspelmath-deepnsm-ce64-harness.md) and [semantic maps ABI notes](2026-10_haspelmath_semantic_maps_grammar_abi_notes.md). + +**Read later:** Verify graph-construction formulae, pruning invariants, semantic connectedness, treatment of polysemy, and held-out crosslinguistic evaluation before designing executable transfers. diff --git a/.arxiv/2502.20233_selective_yannakakis_smash_mask_first_thought_coordinates.md b/.arxiv/2502.20233_selective_yannakakis_smash_mask_first_thought_coordinates.md new file mode 100644 index 000000000..20fa827cb --- /dev/null +++ b/.arxiv/2502.20233_selective_yannakakis_smash_mask_first_thought_coordinates.md @@ -0,0 +1,47 @@ +# Selective Yannakakis / SMASH: choose when to reduce before joining + +**Paper:** Daniela Böhm, Georg Gottlob, Matthias Lanzinger, Davide Longo, Cem Okulmus, Reinhard Pichler, Alexander Selzer, *Selective Use of Yannakakis' Algorithm to Improve Query Performance: Machine Learning to the Rescue*. +**Source:** [arXiv:2502.20233v2](https://arxiv.org/abs/2502.20233v2) | [PDF](https://arxiv.org/pdf/2502.20233v2) | [HTML](https://arxiv.org/html/2502.20233v2) (revised 2025-06-20). +**Read status:** Source-grounded selective review of §§I–II, IV–VI, not independently replicated. **Date:** 2026-10-19. +**Implementation status:** Research only. No code, compiler, CE64 or existing documentation modified. + +## Paper: claims and scope + +The authors study the **algorithm-selection** problem: apply Yannakakis-style semijoin reduction only where it helps query runtime. For a join-tree **acyclic** conjunctive query, the classical algorithm performs a bottom-up semijoin pass, a top-down semijoin pass and then joins reduced relations. + +For eligible **0MA** (zero-materialization-answerable) aggregate queries, *guardedness* and *set-safety* allow the answer to come from the guard after only the bottom-up semijoins. Examples of set-safe aggregates include MIN, MAX and COUNT DISTINCT; ordinary COUNT(*) and bag-sensitive aggregates are **not** automatically equivalent. + +Motivating §I SQL example: PostgreSQL original **3.38 s** vs rewritten **0.11 s**; changing one predicate switches the preferred plan, original **0.05 s** vs rewritten **0.09 s**. A faster theoretical operator may lose on physical overhead. + +The authors' MEAMBench contains **4,677** queries after augmentation. Their supervised selector **SMASH** is evaluated with PostgreSQL, DuckDB and Spark SQL. §VI-D reports minor slowdowns on **over half** of test queries when always rewriting, versus about **2%** with SMASH on its evaluated test workload. The authors emphasize avoiding **false positives** in applying the optimization. + +The paper does **not** benchmark Lance-graph, Lance 13, R2IL, mask-risc, or a shared Cartesian thought address space. Its times and speedup factors must not be presented as our measurements. + +## Lance-graph: directly relevant existing evidence (independent of the paper) + +All 64 active thoughts share **65,536 canonical row coordinates** in one sealed version. For selected aligned thought populations, eliminating nonparticipating rows is direct mask algebra, not foreign-key lookup or trie search. + +~~~text +R = Aperture AND Presence[A] AND Presence[B] AND NOT Exclusion[C] +for each address i in R: + fold(Thought[A][i], Thought[B][i]) +~~~ + +COUNT/EXISTS may terminate on the mask (popcount/any) without a payload read. A complete terminal needs values only at surviving addresses. The identical canonical address is the join witness; equal arbitrary numeric offsets across unrelated domains are not. + +- [#1383](https://github.com/AdaWorldAPI/lance-graph/pull/1383): existing gated semijoin through MaskOp::Gather under a gate. **Not** a recommendation to resurrect forbidden foreign-value gather designs. +- [#1573](https://github.com/AdaWorldAPI/lance-graph/pull/1573): thought-first positional reads, Hamming presence and Lance 13 masked I/O (probe). +- [#1575](https://github.com/AdaWorldAPI/lance-graph/pull/1575): RelAlg normalize -> address R -> Lance 13 RowAddrMask -> terminal (measured probe). +- [#1587](https://github.com/AdaWorldAPI/lance-graph/pull/1587): GYO α-acyclicity test plus a cyclic case where semijoin reduction keeps all rows although the full join is empty. +- [#1590](https://github.com/AdaWorldAPI/lance-graph/pull/1590): shared-coordinate pair is positional; foreign-index/value-addressed gather proposals are marked VIOLATION. +- [#1599](https://github.com/AdaWorldAPI/lance-graph/pull/1599), [#1605](https://github.com/AdaWorldAPI/lance-graph/pull/1605): partial thought squash / Git-like lifecycle remain design proposals, **not** existing physical join execution. + +Lance 13 Scanner::with_row_addr_prefilter accepts irregular RowAddrMask allow-lists, not just contiguous ranges. However, #1575 finds byte-read ratios of **1.00× at uniform 1%**, **0.19× at clustered 1%**, **0.99× at clustered 10%**. Arbitrary logical masks do not guarantee proportional page I/O reductions. Account separately for conversion from R to Lance row IDs, which was outside the timed scanner call. + +## Research-transfer hypothesis, not a paper conclusion + +A query plan selector could choose among (1) common-coordinate positional mask fold, (2) semijoin reduction over **proven** separator projections for real multi-variable joins, and (3) direct execution. A 0MA shortcut requires demonstrated guardedness and set-safety, including exact bag-multiplicity handling when applicable. + +**Falsification suite:** Compare all three at identical answers under (a) aligned rows, (b) unmatched unrelated row universes with the same integer offsets (must refuse), (c) valid acyclic join tree, (d) cyclic #1587 counterexample, (e) duplicate/bag cases, and (f) clustered vs scattered Lance addresses with stale-version mapping. Measure end-to-end wall time, source bytes, conversion, page locality, read amplification and optimizer regret. Compare simple deterministic selection before adding a learned selector or MUL calibration. + +**Boundary:** A masked positional intersection is already available for canonical aligned thought populations; general Yannakakis variable-separator propagation is not proven equivalent to plain AND between unrelated relation domains. No new interpreter or production code authorized. diff --git a/.arxiv/2510.24941_true_thinking_score_decorative_cot_ablation_bookmark.md b/.arxiv/2510.24941_true_thinking_score_decorative_cot_ablation_bookmark.md new file mode 100644 index 000000000..9824b1705 --- /dev/null +++ b/.arxiv/2510.24941_true_thinking_score_decorative_cot_ablation_bookmark.md @@ -0,0 +1,27 @@ +# READ LATER: Can Aha Moments Be Fake? True Thinking Score and decorative CoT + +**Authors:** Jiachen Zhao, Yiyou Sun, Weiyan Shi, Dawn Song. +**Paper:** *Can Aha Moments Be Fake? Towards Quantifying Decorative and True Thinking in Chain-of-Thought*. +**Primary source:** [arXiv:2510.24941v4](https://arxiv.org/abs/2510.24941v4) | [PDF](https://arxiv.org/pdf/2510.24941v4); revised 2026-05-26. +**Status:** ABSTRACT REVIEWED / FURTHER READING QUEUED. Source abstract only; do not treat this as a complete-method reproduction. +**Archived:** 2026-10-19. No code or production claim. + +## Source abstract: what is reported + +The paper proposes a **True Thinking Score (TTS)** to estimate the causal contribution of individual chain-of-thought steps to the model's eventual prediction, distinguishing causally influential steps from fluent but largely **decorative** ones. + +Across 11 LLMs on reasoning benchmarks, the authors report a substantial proportion of low-TTS steps. The v4 abstract says more than 30% of Kimi-K2.6 steps on MATH score TTS <= 0.005. It also reports that removing 50% of lowest-TTS steps largely preserves accuracy, and self-training with pruned traces shortens reasoning by 66% while preserving performance on their specified Nemotron3-Nano-30B setup. + +These figures refer to **the authors' experiments**, not to Lance-graph's 64 thoughts or its measured token/runtime usage. TTS is a paper-specific attribution proxy and is not identical to real-world causal identification. + +## Lance-graph research questions (HYPOTHESES) + +- Does deleting a proposed thought step actually alter predictions, derived facts, source dependencies or verified terminal outcomes? +- Can semantic Git's planned pickaxe/ablation distinguish a necessary premise from decorative narrative, redundant explanations and alternative sufficient proof paths? +- Does a high-confidence tautological restatement create a new independent evidential root? It must not. +- Can identical visible text conceal different internal computations? Compare a saved executable program/revision witness, not a story about reasoning. +- Are deletions measured on frozen held-out fixtures and exact prior versions, with independent negative controls? + +**Boundary:** The paper studies LLM chain-of-thought. It neither implements nor validates the Lance-graph Thought Git API, and intervention on a trace does not prove that a token is a uniquely necessary cause of model behavior. No destructive deletion of repository/history is requested or allowed. + +**Read later:** Examine the TTS intervention protocol, baseline and denominator, stability across repeated runs, counterfactual controls and alternate-proof overdetermination before transferring metrics. diff --git a/.arxiv/2512.17373_dialectics_algorithmic_determinations_excess_information_grounds.md b/.arxiv/2512.17373_dialectics_algorithmic_determinations_excess_information_grounds.md new file mode 100644 index 000000000..d0165e27c --- /dev/null +++ b/.arxiv/2512.17373_dialectics_algorithmic_determinations_excess_information_grounds.md @@ -0,0 +1,40 @@ +# Dialectics for Artificial Intelligence: reversible concepts, excess and grounds + +**Paper:** Zhengmian Hu, *Dialectics for Artificial Intelligence*. +**Source:** [arXiv:2512.17373v2](https://arxiv.org/abs/2512.17373v2) | [PDF](https://arxiv.org/pdf/2512.17373v2) | [extended HTML](https://arxiv.org/html/2512.17373v2); revised 2025-12-23. +**Related edition:** *Entropy*, DOI [10.3390/e28060611](https://doi.org/10.3390/e28060611). Different-length editions; use the cited version for equations/theorem numbers. +**Status:** Focused analysis of the extended arXiv manuscript, NOT a full-text extraction or complete proof verification. **Date:** 2026-10-19. + +## Source-derived ideas + +1. **Determinations / algorithmic parity:** Conceptual parts are represented within reversible consistency structures. For a determination, any missing component is reconstructible from the rest, allowing Kolmogorov-style logarithmic slack. This is an information constraint rather than a generic "thesis versus antithesis" metaphor. + +2. **One-variable completion:** §3.3 Theorem 2 (arXiv v2) gives optimal auxiliary description length, up to stated slack, as max_i K(x_i | x_-i). It is an existence theorem, not an off-the-shelf inexpensive algorithm for arbitrary tuples. + +3. **Excess information:** For a reversible split of experience I into P1 and P2, §§3.5/4 define the representation overhead Δ = K(P1) + K(P2) - K(I). A low-excess split reduces redundant/artificial description under the source's premises. Kolmogorov K is uncomputable in general; practical compression comparisons are proxies. + +4. **Competing absorption of new patches:** A local dialectical move compares alternate *feasible* ways to reorganize concept descriptions, with conditional description costs. One cannot minimize a code length while ignoring reconstructibility or the information the split is required to retain. + +5. **Pivots are not guaranteed:** §3.4 explains why not every rearrangement of determinations is feasible. Failure to reconcile is an admissible result. + +6. **Grounds and communication:** §§4.2–4.3 introduce side information that anchors concept identities and can let a receiving agent recover a concept with a shared deterministic protocol. This does not establish that the receiving agent has correct causal or phenomenological understanding of the external world. + +## Explicit nonclaims + +- Compression is not independent verification of truth, causal origin, generalization, or moral/philosophical insight. +- Reconstructibility cannot turn duplicated evidence from 64 thoughts into 64 independent sources. +- Agreement or reversible encoding does not prove AI subjecthood or consciousness. +- Exact algorithmic complexity is not a practical runtime metric; measured compressor/MDL proxies can disagree. +- Forced Hegelian "synthesis" is not a mathematically warranted move when no feasible reconstruction exists. + +## Proposed Lance-graph relevance, separate from the paper + +The shared 65,536-coordinate address space across 64 thoughts allows alternative *interpretations* and *evidence states* to coexist without changing canonical identity. Compare information-preserving thought transformations using the thought address as the identity and the sealed version/witness as the revision history. Keep orthogonal: interpretation/horizon, evidence roots and NAL F/C, inference rule, causal certification, model version and compressor proxy. + +Existing work: [versioned candidates RFC](../docs/research/versioned-semantic-candidates-64-thoughts-rfc.md), [thought Git plan](../.claude/plans/thought-git-api-v1.md), [Plevrakis](plevrakis_2024_can_ai_be_a_subject_like_us_hegelian_approach.md), [van Tuinen](van_tuinen_2020_philosophy_in_the_light_of_ai_hegel_or_leibniz.md) and [MUL calibration](2210.07278_meta_uncertainty_bayesian_model_comparison_vs_ce64_mul.md). + +**Experiment candidates:** (a) exact reversible XOR/parity split with missing-part recovery; (b) failed pivot where an unresolved alternative must survive; (c) a lower-proxy-code-length split that illegally drops a provenance root (reject); (d) two thoughts with copied evidence (one independent root); (e) varying compressors on held-out fixtures; (f) compression-favored but causally wrong concept assignment (reject any inference of truth). + +**CE64 boundary:** Bits 59..63 remain the single declared Topology2 × Certification3 product. Nothing here authorizes a bitfield change, new rule engine, or altered semantic Git implementation. + +**Implementation status:** Research note only. No full-text redistribution, runtime implementation or production benchmark claimed. diff --git a/.arxiv/2610.12692_distributed_datalog_wcoj_hypercube_bookmark.md b/.arxiv/2610.12692_distributed_datalog_wcoj_hypercube_bookmark.md new file mode 100644 index 000000000..371f15b90 --- /dev/null +++ b/.arxiv/2610.12692_distributed_datalog_wcoj_hypercube_bookmark.md @@ -0,0 +1,27 @@ +# READ LATER: Distributed Datalog at Scale with Worst-Case Optimal Joins + +**Authors:** Kunting Qi, Yihao Sun, Kristopher Micinski, Thomas Gilray, Sidharth Kumar. +**Paper:** *Distributed Datalog at Scale with Worst-Case Optimal Joins*. +**Primary source:** [arXiv:2610.12692v1](https://arxiv.org/abs/2610.12692v1) | [PDF](https://arxiv.org/pdf/2610.12692v1), submitted 2026-10-08. +**Status:** ABSTRACT-LEVEL REFERENCE, FULL PAPER DEFERRED. Primary arXiv page was temporarily unavailable while archiving; title/authors/abstract cross-checked from research indexes, not an independent full-paper review. +**Archived:** 2026-10-19. No code or production claim. + +## Reported in the indexed paper abstract + +The authors study distributed-memory recursive Datalog evaluation with **worst-case optimal joins** (WCOJ), particularly cyclic multi-way joins that can produce very large binary-join intermediates. + +Their approach uses **HyperCube partitioning** with variable-aligned process-grid dimensions. Iterative semi-naive execution repartitions and re-replicates newly derived tuples while retaining a shared layout for local WCOJ intersections. The system uses MPI collectives; the abstract reports scalability results on Argonne's Aurora and Polaris supercomputers. + +These are the authors' claims, **not performance or production guarantees for Lance-graph**. + +## Future Lance-graph comparison + +- A **local aligned** thought-to-thought query over one 65,536-row Cartesian address universe is not the same problem as **distributed multi-variable** WCOJ. The former may collapse to a positional mask fold without trie, repartition, gather or join search. +- The paper is relevant where a query introduces different variable domains, cyclic relation bodies, distributed partitioning or recursive semi-naive fixpoints. +- The implemented GYO α-acyclicity test and cyclic negative fixture in [#1587](https://github.com/AdaWorldAPI/lance-graph/pull/1587) should anchor a source-independent parity comparison. +- Contrast with [the SMASH/Yannakakis note](2502.20233_selective_yannakakis_smash_mask_first_thought_coordinates.md), which is about selectively applying an optimization on conventional DBMS workloads, not distributed recursion. +- Test *bag semantics, cyclic triangle queries, deltas, update/retraction, source-root provenance, physical bytes, and network communication* separately. + +**Not inferred:** Common Cartesian row identity across 64 local thought populations does not magically prove global join-variable equivalence across machines. Avoid transposing MPI speedups onto the mask-risc substrate without an apples-to-apples fixture. + +**Read later:** Verify its HyperCube layout and replication invariants, recursive fixpoint semantics, benchmark workloads, exact comparisons and failure modes from the original PDF before claiming parity or missing features.