paper(gqa): derive (m,l,O) AR per-PE cost from kernel topology

Replaces the unsourced 32 KB/layer placeholder in the analytical chart
with T*(N-1)/N where T = h_q * S_q * (d_head*2 + 8) ~ 2.1 KB
(per-PE (m, l, O) payload) and N is the participant count of the
reduce-only chain per stage. Cases 2/3/6 analytical bars now match
the simulator-measured numbers within ~10% (was 6-30x over).

Also:
- Bumps the measurement S_kv from 8 K to 64 K to verify Cases 1, 2, 3, 6
  are genuinely S_kv-independent and Cases 4, 5 scale linearly.
- In-bar descriptor on the paired chart is now wrapped to fit the bar
  width, black, no background box, and centered between the analytical
  and measured bars so the label applies to both.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
2026-06-18 15:38:20 -07:00
parent 0662c76fa7
commit bb668a3ac3
9 changed files with 62 additions and 30 deletions
@@ -1,5 +1,5 @@
{
"S_kv_measured": 8192,
"S_kv_measured": 65536,
"S_kv_headline": 1048576,
"n_layers": 80,
"num_pes": 64,
@@ -31,19 +31,19 @@
},
"4": {
"label": "Case 4 (Cube-SP x PE-TP d_head)",
"total_ipcq_bytes_one_layer": 1851136,
"per_pe_partial_score_bytes_one_layer": 16384,
"per_pe_mlo_bytes_one_layer": 12540,
"per_pe_attn_bytes_per_token_at_1M": 168775360,
"per_pe_total_bytes_per_token_at_1M": 170086080
"total_ipcq_bytes_one_layer": 14696192,
"per_pe_partial_score_bytes_one_layer": 131072,
"per_pe_mlo_bytes_one_layer": 98556,
"per_pe_attn_bytes_per_token_at_1M": 175656640,
"per_pe_total_bytes_per_token_at_1M": 176967360
},
"5": {
"label": "Case 5 (Cube-TP d_head x PE-SP)",
"total_ipcq_bytes_one_layer": 1851136,
"per_pe_partial_score_bytes_one_layer": 16384,
"per_pe_mlo_bytes_one_layer": 12540,
"per_pe_attn_bytes_per_token_at_1M": 168775360,
"per_pe_total_bytes_per_token_at_1M": 170086080
"total_ipcq_bytes_one_layer": 14696192,
"per_pe_partial_score_bytes_one_layer": 131072,
"per_pe_mlo_bytes_one_layer": 98556,
"per_pe_attn_bytes_per_token_at_1M": 175656640,
"per_pe_total_bytes_per_token_at_1M": 176967360
},
"6": {
"label": "Case 6 (Cube-SP x PE-SP) [*]",
Binary file not shown.

Before

Width:  |  Height:  |  Size: 134 KiB

After

Width:  |  Height:  |  Size: 132 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 182 KiB

After

Width:  |  Height:  |  Size: 183 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 185 KiB

After

Width:  |  Height:  |  Size: 182 KiB