Skip to content

mesh-llm, skippy-native-runtime-cuda, -rocm: 0.79.0 -> 0.80.0, check runtime discovery and tool modes - #12

Closed
kleinbem wants to merge 5 commits into
mainfrom
feat/runtime-discovery
Closed

kleinbem wants to merge 5 commits into
mainfrom
feat/runtime-discovery

Conversation

@kleinbem

Copy link
Copy Markdown
Owner

On top of #9. Mirrors the nixpkgs runtime-discovery tests: check() in the mesh-llm pkgbase asks the built mesh-llm to list the CPU and Vulkan runtimes it built, and the CUDA and ROCm pkgbases check that tools/mesh-llm-gpu-benchmark is executable (mesh-llm starts it itself; Mesh-LLM/mesh-packaging#47 is the same bug in upstream's packages).

The CUDA and ROCm pkgbases build no mesh-llm, so their discovery is not checked here.

CI builds all three pkgbases; that run is the test.

🤖 Generated with Claude Code

kleinbem and others added 3 commits November 11, 2026 15:24
…0.79.0

The release counterparts of the -git pkgbases in #2: one split pkgbase
(mesh-llm, skippy, CPU and Vulkan runtimes) and one per GPU runtime,
built from the v0.79.0 tag tarball and the llama.cpp release it pins
(b12199), with checksums. prepare() fails if the two pins drift apart.

Each runtime package also installs llama.cpp's MIT license, and each
directory carries the 0BSD LICENSE the AUR expects.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…y env

Upstream keeps sccache and its linker drivers in .cargo/config.toml on
purpose, so the packages override them with CARGO_BUILD_RUSTC_WRAPPER=
and CARGO_TARGET_<TRIPLE>_LINKER=cc instead of editing the file with sed.
One _cargo_env helper per PKGBUILD replaces the repeated exports.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… runtime version

Upstream's runtime build fetches whisper.cpp from GitHub. The pinned
commit is now a source, and the build points WHISPER_UPSTREAM_URL at the
local clone; prepare() checks it against whisper-upstream.txt.

MeshLLM only loads a runtime of its own release, so mesh-llm and skippy
depend on skippy-native-runtime=$pkgver, and the Vulkan, CUDA and ROCm
runtimes conflict with any other mesh-llm or skippy version.

The runtimes need AVX2, FMA, F16C and BMI2 like upstream's
(Mesh-LLM/mesh-llm#2691); an install script warns on CPUs without them.
Each remaining workaround comment now names its upstream reference or
says why there is none.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Nov 18, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are limited based on label configuration.

🏷️ Required labels (at least one): 1

  • cr-review

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration

  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Central YAML; Path: .coderabbit.yaml
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 3154493d-9ab0-4ec2-a8d4-f7386a23576b

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

llama.cpp b12199 -> b12340 (the commit 0.80.0 pins); whisper.cpp unchanged.
…and tool modes

mesh-llm's check() asks the built mesh-llm to list every runtime of this
pkgbase, as nixpkgs' runtime-discovery tests and upstream's package QA do.
The CUDA and ROCm runtimes check that tools/mesh-llm-gpu-benchmark is
executable: mesh-llm starts it itself and refuses it otherwise.
@kleinbem
kleinbem force-pushed the feat/runtime-discovery branch from f126457 to c55c0da Compare November 18, 2026 14:42
@kleinbem kleinbem changed the title mesh-llm, skippy-native-runtime-cuda, -rocm: check runtime discovery and tool modes mesh-llm, skippy-native-runtime-cuda, -rocm: 0.79.0 -> 0.80.0, check runtime discovery and tool modes Nov 18, 2026
@kleinbem
kleinbem changed the base branch from feat/mesh-llm-0.79 to main November 18, 2026 18:36
@kleinbem

Copy link
Copy Markdown
Owner Author

Folded into #9, which now has this commit.

@kleinbem kleinbem closed this Nov 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant