Skip to content

feat: overlap CPU cold-expert and GPU hot-expert computation in the MoE cache - #9

Merged
thecodacus merged 5 commits into
perffrom
fable5/moe-cache-overlap
Aug 22, 2026
Merged

feat: overlap CPU cold-expert and GPU hot-expert computation in the MoE cache#9
thecodacus merged 5 commits into
perffrom
fable5/moe-cache-overlap

fix: restrict CPU-pinned merge to decode-size batches

1fcb831
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar