Skip to content

Add exl3xpu runtime + exl3-4bpw quant (Qwen3.8-27B board) - #50

Merged
jackwsmth merged 1 commit into
labscommunity:mainfrom
SergiioB:catalog-exl3-qwen38
Sep 28, 2026
Merged

jackwsmth merged 1 commit into
labscommunity:mainfrom
SergiioB:catalog-exl3-qwen38

Conversation

@SergiioB

Copy link
Copy Markdown
Contributor

Summary

Catalog entries needed before EXL3 result files can ingest (see #49):

  • RUNTIMES: exl3xpu — https://github.com/0xSero/exl3xpu, the ExLlamaV3 XPU port used to serve EXL3 checkpoints on Intel Arc
  • QUANTS: exl3-4bpw — EXL3 trellis quantization, ~4 bits per weight
  • qwen3-8-27b board gains exl3-4bpw
  • supabase/migrations/20260927120000_catalog_exl3_4bpw_exl3xpu.sql mirrors the pattern of catalog_q4_k_l.sql

Validation

npm run catalog:validate — 46 hardware / 32 models / 18 quants / 8 runtimes, all resolve.

Once this deploys, the result ingestion on #49 can be rerun.

New runtime id exl3xpu (https://github.com/0xSero/exl3xpu — the ExLlamaV3
XPU port used to serve EXL3-quantized checkpoints on Intel Arc), new quant
id exl3-4bpw (EXL3 trellis ~4 bits per weight), and the exl3-4bpw board on
qwen3-8-27b. Seed migration mirrors earlier catalog migrations.
@vercel

vercel Bot commented Sep 27, 2026

Copy link
Copy Markdown

Someone is attempting to deploy a commit to the Community Labs Team on Vercel.

A member of the Team first needs to authorize it.

@github-actions

github-actions Bot commented Sep 27, 2026 •

Copy link
Copy Markdown
No result files to import.

Site / sign up · Workflow details and retry

@vercel

vercel Bot commented Sep 28, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
intelinside Ready Ready Preview Sep 28, 2026 6:18am UTC

Request Review

@jackwsmth
jackwsmth merged commit 4bd33d9 into labscommunity:main Sep 28, 2026
6 checks passed

This branch was successfully deployed

1 active deployment
Preview — 5f0a1598 Deployed Sep 28, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants