Skip to content

WIP (paused): console Models catalog QA - #8

Draft
lpalbou wants to merge 3 commits into
mainfrom
feat/catalog-extended-quants
Draft

lpalbou wants to merge 3 commits into
mainfrom
feat/catalog-extended-quants

Conversation

@lpalbou

@lpalbou lpalbou commented Oct 28, 2026 •

Copy link
Copy Markdown
Owner

Paused by the coordinator on 2026-10-28. This is not for merge yet.

State

  • capabilities.inputs / capabilities.outputs are added to the catalog projection (model_catalog._capabilities). They come from model_capabilities.json capability_routes, with embedding and rerank added as outputs.
  • The seed rows the registry does not cover (29 rows: image, video, voice and music engines, small text models, embeddings) now carry curated capabilities_override.inputs/outputs.
  • New 1bit quant class, so UD-IQ1 builds are labelled 1-bit instead of "Not stated". The bits table gains the Unsloth Q*_K_XL builds. The quant-class tests are updated on purpose.
  • Merged origin/main (2.31.1, which includes the LFM rows from backlog 0860).

Next steps

  1. Extended quant enumeration, per row and on demand. Trusted publishers: unsloth (GGUF), mlx-community (MLX) and the vendor's official org. Each label's size is exact from the HF file list, cached. Skip the labels whose download pattern over-fetches (Q2_K, F16).
  2. Tests: the seed inputs/outputs invariant, the extended set, and trusted sources. Backlog 0861/0862, 2.31.2.
  3. AbstractRuntime: pass extended through the facade (0.15.3), because gateway ADR 0001 forbids importing Core directly.
  4. Gateway 0.17.4:
    • Download scroll: cause found. mcRenderView_ replaces the whole list innerHTML, and WebKit then jumps the scroll position. Fix by patching only the changed cards and rows.
    • Takes/Produces filter row.
    • "Extended quantizations" toggle.
    • Raise the floors.

Full findings: untracked/release-closing/design/catalog/STATE.md in the workspace.


Note (2026-10-29): batch item (b), the extended quant enumeration (the old step 1), landed separately in the 0865 PR (catalog(extended=True), gguf_quant_labels). Rebase onto it and keep this PR to its remaining scope (inputs/outputs, the 1bit class). Backlog numbers 0861 to 0865 are taken.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant