跳到正文
arXiv· Kwun Fung Lau·· 2 天前

Causal Attention on CPU: A Cache-Aware and Load-Balanced Scheduling Kernel for Prefill

Causal Attention on CPU: A Cache-Aware and Load-Balanced Scheduling Kernel for Prefill

来源:arXiv · arxiv.org