Skip to content

[feature] 迁移 LMCache Quick Start 并接入看护 - #166

Open
licy666 wants to merge 3 commits into
Ascend:mainfrom
licy666:feat/lmcache-quick-start
Open

licy666 wants to merge 3 commits into
Ascend:mainfrom
licy666:feat/lmcache-quick-start

Conversation

@licy666

@licy666 licy666 commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Summary

  • LMCache/LMCache-Ascend 的昇腾 Quick Start 迁到 Ascend/docs:用户文档、测试子类、薄触发器、首页卡片和 toctree 同一 PR。主仓 LMCache/LMCache 没有昇腾实现,monitor 的 upstream_repoLMCache/LMCache-Ascend
  • 可见命令直连 GitHub 与 Hugging Face;模型走默认 Hub 缓存 Qwen/Qwen2.5-0.5B-Instruct。薄触发器不传 container_options / --volume,镜像钉 cann:9.1.0-910b-ubuntu22.04-py3.12,runner 单卡 linux-aarch64-a2-1
  • vLLM 按统一三步 pip:vllm==0.23.0vllm-ascend==0.23.0--force-reinstall --no-deps triton-ascend==3.2.2。补丁脚本和离线卸载脚本拆成无标签 .py + 隐藏 #test-setup cat + 可见 python path.py。工作负载 #test-result 含设备锚点 Platform plugin ascend is activated / Using NPU for LMCache engine / current_device npu:0

选型(不进用户正文)

  • 看护钉最新 Release v0.4.4,不跟 main。这个 tag 在 CANN 9.1 上编 HIXL 缺 pkg_inc 这一层 include(PR 288 已合进 main,尚未进 Release);子类 LMCacheAscendConnectorV1Dynamic 到 main 仍是两参数构造,vLLM 0.23 工厂会因缺少 kv_cache_config 直接 ValueError。因此克隆后必须先跑本地补丁再编译;源码已有对应内容时脚本跳过。
  • 引擎规定 HTML 注释里只能放 #test-setup,不能把 #test 藏进去。可见无标签 Python 围栏给人复制保存,CI 靠注释里的 cat 落盘,再由可见 #test 真正执行 python patch_lmcache_ascend.py
  • 不改共享引擎 quick-start-template.yml / tests/doc_test/

Test plan

  • actionlint 薄触发器
  • py_compile 测试子类
  • 解析:7 个 #testcheck-tools / install-system-prereqs / install-vllm / install-lmcache / clone-lmcache-ascend / install-lmcache-ascend / offload),5 个隐藏 #test-setup;注释里没有 #test / #test-result
  • 可见正文无 cosdt-ci-test / /root/.cache / modelscope / gh-proxy / python - <<
  • patch_lmcache_ascend.pyoffload_qs.py 的可见围栏与隐藏 cat 字节一致
  • 香港 A2 冷缓存 workflow_dispatch:clone + 编译 HIXL + Hub 下载 + 设备锚点
  • 香港 A2 热缓存:/root/.cache/huggingface/hub 已有模型后重跑卸载段

coder 出口网络和香港 A2 runner 不同,GitHub clone / Hugging Face 下载没有在 coder 上当作 e2e 证据。合入默认分支前对新 workflow 做 workflow_dispatch 会 404;合入后在香港 A2 上补冷/热两次。

@ascend-robot

Copy link
Copy Markdown

CLA Signature Pass

licy666, thanks for your pull request. All authors of the commits have signed the CLA. 👍

github-actions Bot pushed a commit that referenced this pull request Sep 10, 2026
@github-actions

github-actions Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

📖 文档预览https://ascend.github.io/docs/pr-preview/pr-166/sources/lmcache/

也可打开整站首页

构建自 96f80d6bc23ab4454a18f4e469db1a993c7b0711
每次推送后自动更新,PR 关闭时自动清理。

@ascend-robot

Copy link
Copy Markdown

CLA Signature Pass

licy666, thanks for your pull request. All authors of the commits have signed the CLA. 👍

github-actions Bot pushed a commit that referenced this pull request Sep 10, 2026
@ascend-robot

Copy link
Copy Markdown

CLA Signature Pass

licy666, thanks for your pull request. All authors of the commits have signed the CLA. 👍

github-actions Bot pushed a commit that referenced this pull request Sep 10, 2026
@licy666
licy666 force-pushed the feat/lmcache-quick-start branch from 0a9f412 to d21f28c Compare September 21, 2026 02:25
@ascend-robot

Copy link
Copy Markdown

CLA Signature Pass

licy666, thanks for your pull request. All authors of the commits have signed the CLA. 👍

把 LMCache-Ascend 的昇腾入门文档接到 Ascend/docs 的 doc-test 看护:用户文档、测试子类、薄触发器和首页卡片同一提交。Release v0.4.4 在 CANN 9.1 / vLLM 0.23 上仍需本地 CMake include 与 KV connector 补丁,CI 通过隐藏 #test-setup 落盘后再跑可见 python。
v0.4.4 的 setup.py 优先读 npu-smi,香港 A2 是 Ascend910B3,命令行 SOC_VERSION=Ascend910B4 不会进 _build_info,预期输出对不上。
#test-result 开头单独一行 ... 会要求下一句前面有换行,但补丁脚本的 stdout 第一行就是 patched_ok True,比对会失败。
@ascend-robot

Copy link
Copy Markdown

CLA Signature Pass

licy666, thanks for your pull request. All authors of the commits have signed the CLA. 👍

github-actions Bot pushed a commit that referenced this pull request Sep 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants