List of AI News about GQA
| Time | Details |
|---|---|
|
2026-06-29 09:13 |
LLM Prefill Decode Explained: Cut TTFT and ITL
According to @_avichawla, prefill is compute-bound and decode is memory-bound, shaping TTFT and ITL. Tackle KV cache growth with GQA, PagedAttention, quantization. |