Section 1 rewritten so a layman can read it without a glossary:
1. **Symbol legend table** listing every letter that appears in the
three-axis formulas (N, b, N·b, HBM_per_PE, S_kv, kv_bpt,
users_per_replica, TPOT SLO, step_latency, B_at_SLO, n_users,
N_replicas, ⌈ ⌉). Each row: Symbol / Plain English / Value now
for the current sidebar model + chip. For example:
- N = 'Total number of model parameters (attention weights +
FFN weights, across ALL layers)' → 6.98 billion params for
Llama 3 8B
- kv_bpt = 'KV cache bytes per token per user, summed across all
layers (= 2·H_kv·d_head·b·layers)' → 128 KB/token
2. **Three-axis table** widened from (Formula / Meaning / Grows with)
to (In symbols / In plain English / What it says / Value now).
Axis A now shows the actual substituted arithmetic:
⌈ 13.96 GB / 6.0 GB ⌉ = ⌈ 2.33 ⌉ = 3 PEs.
B and C flag 'see calculator' because they depend on user inputs.
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
mukesh
5ce7a5b30b