2026
CLM-AI-003627= Theta(layers * T * H_kv * d_h)ASYMPTOTIC BOUNDThe cited theorem establishes Theta(layers * T * H_kv * d_h) under the recorded model.Source: Fast Transformer Decoding: One Write-Head is All You Need — Autoregressive transformer KV-cache size ↗
PROVEN