Skip to content

feat(dory): hand off prompts between prefill and decode workers - #203

Draft
XinhaoTheo wants to merge 7 commits into
InferMatrixLab:mainfrom
XinhaoTheo:feat/rfc176-dory-pd-handoff
Draft

XinhaoTheo wants to merge 7 commits into
InferMatrixLab:mainfrom
XinhaoTheo:feat/rfc176-dory-pd-handoff

feat(dory): hand off prompts between prefill and decode workers

985b12f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs