Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions _fleet/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,11 @@
feature spot-check cannot redate the entire row. An entry without a published
site cannot carry a website recheck. Adding these optional fields is a
provenance assertion, not an automatic browser test or approval of a feature.
The November 19, 2026 full feature-only revalidation covers all sixteen published
corpus sites and moves the common feature baseline to that date; its retained
[observations, independent reviews and arbitration](reviews/site-features-20261119/README.md)
are separate from the unchanged corpus census and pins. EdgeMech's proposed
sample browser is tracked in its own PR and is not counted as published here.
- `audit_notes.json` — hand-checked explanations of each source and its counted
entities. PathwayMech records, DUFMech seed families, CofactorMech cofactors
and AssayMech assays use the same pinned census, statistics and site-audit
Expand Down
668 changes: 332 additions & 336 deletions _fleet/data/site_features.json

Large diffs are not rendered by default.

27 changes: 27 additions & 0 deletions _fleet/reviews/site-features-20261119/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Local uncompressed browser captures and screenshots are preserved for inspection.
# Published gzip archives are byte-identical and indexed by SHA-256.
*.png
/root/cofactor-canary.json
/root/assay-auditor.json
/root/aimech-auditor.json
/root/aimech-auditor-v2.json
/root/aimech-supplement.json
/root/trait-auditor.json
/group-a/*/audit-*/raw.json
/group-a/*/audit-*/followup-*.json
/group-a/HabitatMech/audit-1/
/group-a/HabitatMech/audit-2/
/group-a/PathwayMech/audit-1/
/group-a/CellStructureMech/audit-1/
/group-b/culturemech.json
/group-b/culturemech-supplement.json
/group-b/mediaingredientmech.json
/group-b/mediaingredientmech-supplement.json
/group-b/proteintraitsmech.json
/group-b/proteintraitsmech-supplement.json
/group-b/proteintraitsmech-controls.json
/group-b/dufmech.json
/group-b/naturalproductmech.json
/group-b/naturalproductmech-supplement.json
/group-b/cmmmech.json
/group-b/*-review-followup.json
83 changes: 83 additions & 0 deletions _fleet/reviews/site-features-20261119/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,83 @@
# Live browser-feature revalidation — November 19, 2026

This is a feature-only revalidation of the sixteen published corpus Mech sites.
The audit date uses America/Los_Angeles; raw observation timestamps use UTC.
It does not refresh the corpus census, card figures, corpus pins, or membership.
`scope.json` records the current canonical public fleet and verifies that its
public membership agrees with the retained manifest.

The existing 24 criteria were retained. A new deployment was a reason to inspect
the served site, not evidence that any rating changed. Each accepted capture
records a successful deployment before and after the browser pass and a served
Last-Modified date at least as recent as that deployment request. Browser checks
cover reader actions, populated details, themes, fresh and resized 390px layouts,
and failed-request recovery. Catalogue claims have separate complete-index,
manifest or deployed-source inventory evidence. Most individual record pages
were sampled; CofactorMech and AssayMech were checked exhaustively.

## Evidence and reproduction

- `root/proposals.json`: TraitMech, AIMech, CofactorMech and AssayMech auditor judgments.
- `group-a/proposals.json`: HabitatMech, CommunityMech, TaxonMech, PathwayMech,
CellStructureMech and AntibioticMech auditor judgments.
- `group-b/proposals.json` and `group-b/evidence.json`: CultureMech,
MediaIngredientMech, ProteinTraitsMech, DUFMech, NaturalProductMech and CMMMech.
- `changes.json`: previous and final feature values, with rating changes distinguished
from changes to notes and counts.
- `review-complete.json`: independent reviewer assignments and completion record.

Large captures are committed as deterministic `.json.gz` files. Decompress a
file before following its JSON pointer or documented locator. Publication indexes
record the uncompressed and archive SHA-256 values. The uncompressed originals and
screenshots remain local and ignored; archives preserve the complete captured
observations. Group B's evidence index maps logical `.json` names to these archives.
Incomplete/superseded attempts are excluded: Habitat audit-1/audit-2, Pathway
audit-1, CellStructure audit-1 and root AIMech auditor v1.

The `scripts/adhoc/revalidate_*20261119*.py` helpers retain the observation,
coverage, packaging and integration procedures. Browser helpers require Python
with Playwright and an installed Chromium/Chrome executable, plus authenticated
read access through `gh`. They write new receipt paths and do not edit source
corpora. Rerunning a live observation later may observe a different deployment;
it is not a deterministic reproduction of a historical website.

The integration helper reads the immutable website baseline and the reviewed
proposals, then updates only `_fleet/data/site_features.json` and the change
ledger. `scripts/fleet/assemble_page.py` regenerates `mechs.md` from those sources.

## Scope of the EdgeMech work

[EdgeMech PR #225](https://github.com/CultureBotAI/EdgeMech/pull/225) implements a
separate sample-occurrence browser. It is not counted as a published browser in
this audit. It exposes the public 10,000-occurrence sample, not the full native
graph; its 100 historical canary reviews retain distinct source-fidelity and
scientific-support assessments. Deployment and a later live-site audit must
precede adding it to this published-site matrix.

## Findings tracked separately

- [MediaIngredientMech #1548](https://github.com/CultureBotAI/MediaIngredientMech/issues/1548):
inconsistent data/code licence notices across browser, maps and schema routes.
- [MediaIngredientMech #888](https://github.com/CultureBotAI/MediaIngredientMech/issues/888):
existing issue reproduced for a plain-text DOI in GYPS component evidence.
- [CommunityMech #2716](https://github.com/CultureBotAI/CommunityMech/issues/2716):
existing issue reproduced for broken TaxonMech record handoffs.
- [CommunityMech #2959](https://github.com/CultureBotAI/CommunityMech/issues/2959):
text and sequence maps ignore the saved dark preference.
- [TraitMech #2098](https://github.com/CultureBotAI/TraitMech/issues/2098):
discussion index omits the project data and code licence notices.
- [PathwayMech #809](https://github.com/CultureBotAI/PathwayMech/issues/809):
manual theme variables do not control the main page background and text.
- [AntibioticMech #1374](https://github.com/CultureBotAI/AntibioticMech/issues/1374):
generic MediaIngredientMech exploration links use a missing route. The working
specific-record relationship keeps that separate criterion present.
- [Hub #626](https://github.com/CultureBotAI/CultureBotAI.github.io/issues/626):
corrected TraitMech evidence pointers and an unproven CellStructureMech
point-activation claim before publication.
- [Hub #628](https://github.com/CultureBotAI/CultureBotAI.github.io/issues/628):
final PR review corrected TaxonMech's generic-search rating and grounded
HabitatMech's partial rating in its named associated taxa.

These upstream site defects are reflected in the ratings. This revalidation does
not silently fix or close them. The new EdgeMech implementation has its own
independent review and issue record in its PR.
68 changes: 68 additions & 0 deletions _fleet/reviews/site-features-20261119/arbitration.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
{
"date": "2026-11-19",
"arbiter": "root editor, after separate auditor and skeptic passes",
"overrides": [
{
"mech": "TaxonMech",
"feature": "cross_mech_links",
"auditor_status": "partial",
"final_status": "missing",
"final_note": "The three sampled taxon detail pages offer generic sibling-browser searches and home links, but do not identify or link specific related records in sibling Mechs or kg-microbe.",
"reason": "Apply the same specific-record criterion as AIMech and CMMMech. Generic searches alone do not qualify for partial, regardless of whether their routes work.",
"evidence": "_fleet/reviews/site-features-20261119/group-a/TaxonMech/audit-1/raw.json.gz#/pages",
"issue": "https://github.com/CultureBotAI/CultureBotAI.github.io/issues/628"
},
{
"mech": "HabitatMech",
"feature": "cross_mech_links",
"auditor_status": "partial",
"final_status": "partial",
"final_note": "Marine sediment's Associated taxa table names specific taxa and NCBITaxon IDs beside TaxonMech search links, rather than direct links to the corresponding individual taxon records.",
"reason": "Named related records with search-only handoffs support partial; unrelated generic Explore failures are not the evidence for this criterion. Table anchors are retained in desktop.links, not all_links.",
"evidence": "_fleet/reviews/site-features-20261119/group-a/HabitatMech/audit-3/raw.json.gz#/pages/https:~1~1culturebotai.github.io~1HabitatMech~1pages~1habitats~1marine-sediment-envo-03000033.html/desktop/links",
"issue": "https://github.com/CultureBotAI/CultureBotAI.github.io/issues/628"
},
{
"mech": "PathwayMech",
"feature": "theme_toggle",
"auditor_status": "present",
"final_status": "partial",
"final_note": "The manual dark choice persists in storage and the theme attribute, but the body remains light under a light OS preference. Manual rules update different CSS variables from those used by body text/background, producing mixed light and dark regions across the sampled pages.",
"reason": "Computed styles and the sequence-map screenshot contradict the initial attribute-only inference. A saved theme must also apply visually.",
"issue": "https://github.com/CultureBotAI/PathwayMech/issues/809"
},
{
"mech": "AntibioticMech",
"feature": "cross_mech_links",
"auditor_status": "partial",
"final_status": "present",
"final_note": "D-cycloserine links directly to the specific PathwayMech WikiPathways:WP5060 record, which returns HTTP 200. Generic Explore searches are distinct from these specific-record relationships; their broken MediaIngredientMech route is tracked separately.",
"reason": "Apply the specific-record criterion consistently with CultureMech, MediaIngredientMech and NaturalProductMech. A generic name search is not a specific-record relationship. The concrete exploration defect remains filed.",
"issue": "https://github.com/CultureBotAI/AntibioticMech/issues/1374"
},
{
"mech": "CellStructureMech",
"feature": "domain_view",
"auditor_status": "present",
"final_status": "present",
"final_note": "The text map renders all 1,022 structures. The sequence map renders 469 proteins associated with 140 structures; its populated context links the associated structure record.",
"reason": "A canvas-centre click did not change the default selection, so it does not establish a successful point activation. Retain the observed visualization and linked-context claim only.",
"issue": "https://github.com/CultureBotAI/CultureBotAI.github.io/issues/626"
}
],
"root_proposal_corrections": [
{
"mech": "TraitMech",
"feature": "license",
"final_status": "partial",
"reason": "The linked discussion index lacks project data/code licence notices; apply the same linked-page coverage rule as HabitatMech and MediaIngredientMech.",
"issue": "https://github.com/CultureBotAI/TraitMech/issues/2098"
},
{
"mech": "TraitMech",
"features": ["term_links", "cross_mech_links", "build_provenance"],
"reason": "Point evidence at the actual aerobic-respiration and Wood-Ljungdahl source pages and the captured landing/Browse/map footers. The correct observations already existed; statuses do not change.",
"issue": "https://github.com/CultureBotAI/CultureBotAI.github.io/issues/626"
}
]
}
Loading