Skip to content

0867: GGUF architecture support check (spark2_5 says it cannot load here) - #19

Merged
lpalbou merged 3 commits into
mainfrom
feat/gguf-architecture-support-check
Oct 29, 2026
Merged

lpalbou merged 3 commits into
mainfrom
feat/gguf-architecture-support-check

Conversation

@lpalbou

@lpalbou lpalbou commented Oct 29, 2026

Copy link
Copy Markdown
Owner

Batch item (f). Stacked on #18; retarget to main once it merges.

  • An installed GGUF's row carries architecture. When this install's llama-cpp-python does not name it, the row also gets loadable: false and unloadable_reason ("This computer's llama.cpp (llama-cpp-python X) cannot load the spark2_5 architecture…").
  • The check reads libllama's own table of architecture names without importing llama_cpp, cached.
  • Verified live on the server's libllama: spark2_5 is unknown; qwen35, gemma4 and lfm2 are known.
  • Tests: a stand-in library case, plus this machine's real library. Before-download flagging (HF gguf.architecture) is a follow-up.

No version bump.

…(libllama's own architecture table; loadable false + reason); tests
…referred; a name may be a merged string tail (end-anchored match, fail-safe); tests
@lpalbou
lpalbou changed the base branch from fix/installed-gguf-tasks to main October 29, 2026 04:44
@lpalbou
lpalbou merged commit 6cc238f into main Oct 29, 2026
11 checks passed
lpalbou added a commit that referenced this pull request Oct 29, 2026
…ebase-only admin merge)

A Hub GGUF this llama.cpp cannot load is flagged before download (0868, stacked on #19)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant