Skip to content

[feature]支持lm-evaluation-harness的quick start文档测试看护 - #175

Open
lltiaor wants to merge 1 commit into
Ascend:mainfrom
lltiaor:feat/lm-evaluation-harness-quick-start
Open

lltiaor wants to merge 1 commit into
Ascend:mainfrom
lltiaor:feat/lm-evaluation-harness-quick-start

Conversation

@lltiaor

@lltiaor lltiaor commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

总结

为 lm-evaluation-harness(lm-eval)接入 quick start 文档测试看护。

看护内容为 :单卡昇腾 NPU 上以 跑通 arc_easy(0-shot) 与 winogrande(5-shot) 两个官方评测任务;Qwen2.5-0.5B-Instruct(约 1 GB)与两个数据集的 parquet 均经 ModelScope 下载,脚本复制官方任务 YAML ,最后校验两个任务准确率都落在 [0,1]。

变更文件

  • 新增:sources/lm_evaluation/quick_start.md.github/workflows/lm-evaluation-harness-quick-start.ymltests/lm_evaluation/
  • 删除:sources/lm_evaluation/index.rstinstall.rstquick_start.rst
  • 调整:首页 index.rst toctree 直接收录 sources/lm_evaluation/quick_start.md,卡片「快速上手」指向其构建产物(移除已失效的「安装指南」)

验证

  • github action测试全绿通过

@ascend-robot

Copy link
Copy Markdown

CLA Signature Pass

lltiaor, thanks for your pull request. All authors of the commits have signed the CLA. 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants