Skip to content

[Dory] Enable prefix caching for per_loop and last_loop KV with SWA reclamation - #190

Open
HowardYangAI wants to merge 4 commits into
InferMatrixLab:mainfrom
HowardYangAI:dory-2c-prefix
Open

HowardYangAI wants to merge 4 commits into
InferMatrixLab:mainfrom
HowardYangAI:dory-2c-prefix

refactor(core): derive Dory SWA reclamation in the engine

8e854d3
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs