Code

✨ allow single-shard paged attention#86

Code

Open

joerunde wants to merge 2 commits intomainIBM/text-generation-inference:mainfrom

paged-attnIBM/text-generation-inference:paged-attnCopy head branch name to clipboard

Commits

Commits on May 6, 2024

• :sparkles: allow single-shard paged attention

  Show description for 9fc037c
  joerunde

  committed
  9fc037c

  Copy full SHA for 9fc037c

Commits on May 7, 2024

• Merge branch 'main' into paged-attn

  joerunde

  authored
  7b76cd0

  Copy full SHA for 7b76cd0