-
fc4747668e
paper(§5): add roofline, capacity planning, parallelism selection subsections
master
mukesh
2026-07-30 15:56:41 -07:00
-
bfe3e0e8d1
analytical-viz: parallelism rules — Section 11 TP vs CP shared-budget
mukesh
2026-07-30 09:26:22 -07:00
-
55653cbb3e
analytical-viz: new 'Parallelism rules' tab
mukesh
2026-07-30 09:11:08 -07:00
-
5ce7a5b30b
analytical-viz: capacity planning — symbol legend + plain-English formulas
mukesh
2026-07-30 08:35:59 -07:00
-
bc5e704572
analytical-viz: Physical Layout — TTFT & TPOT full-model latency section
mukesh
2026-07-29 15:51:06 -07:00
-
c39bbb16aa
analytical-viz: capacity planning tab — add public-example B/replica table
mukesh
2026-07-29 15:44:35 -07:00
-
77abc95d78
analytical-viz: capacity planning tab — add rules of thumb + deployment templates
mukesh
2026-07-29 15:13:08 -07:00
-
f54822d247
analytical-viz: move capacity planning to its own tab, table-first layout
mukesh
2026-07-29 15:09:58 -07:00
-
b7c4c680aa
analytical-viz: roofline tab — 'How hyperscalers pick GPU count' section
mukesh
2026-07-29 15:07:20 -07:00
-
6410c0843c
analytical-viz: roofline tab — fix NameError from knob-rename refactor
mukesh
2026-07-29 14:51:01 -07:00
-
97e765b58f
analytical-viz: roofline knobs — absolute TFLOPS / GB/s, drive whole tab
mukesh
2026-07-29 14:47:30 -07:00
-
bda76cbd66
analytical-viz: roofline tab — drop formula from step-latency header
mukesh
2026-07-29 14:14:24 -07:00
-
a1c3c28f62
analytical-viz: roofline tab — PE memory budget, AI sensitivity, FLOPs/BW knobs
mukesh
2026-07-29 14:10:02 -07:00
-
9b4aee83da
analytical-viz: roofline tab — trim to 4 plots, cap B at 256 / S_kv at 1M
mukesh
2026-07-29 13:52:40 -07:00
-
221097ef08
analytical-viz: roofline tab — headline step-latency + cost-per-token plots, B knob
mukesh
2026-07-29 13:40:37 -07:00
-
c99a238826
analytical-viz: roofline tab — S_kv knob, regime formulas, good B/L, decomp plot, split table
mukesh
2026-07-29 13:27:17 -07:00
-
04c7d247f0
analytical-viz: roofline formula table shows substituted numeric form
mukesh
2026-07-29 12:04:47 -07:00
-
1ddd1baa7a
analytical-viz: 'Chip roofline & B*' tab — AI, B*, L*, cost curves
mukesh
2026-07-29 11:59:19 -07:00
-
5e92b89821
analytical-viz: PE view keeps CP rank locator visible at TP>=8
mukesh
2026-07-29 10:19:39 -07:00
-
3360be2488
analytical-viz: consolidate shape tables under Physical Layout tab
mukesh
2026-07-29 10:14:08 -07:00
-
adc14c84af
analytical-viz: per-stage tensor shape tables (attention + FFN)
mukesh
2026-07-29 10:05:02 -07:00
-
9c5062bdfb
analytical-viz: memory-min buttons reset stale placement/mode session keys
mukesh
2026-07-28 23:45:38 -07:00
-
4ded67a443
analytical-viz: sidebar memory-min buttons are scope-aware (Attn / FFN / Attn+FFN)
mukesh
2026-07-28 23:34:05 -07:00
-
47c4f40f4d
analytical-viz: batch B in every formula string + rename 'latency-optimal' → 'memory-optimal'
mukesh
2026-07-28 23:20:32 -07:00
-
50aab8d591
analytical-viz: complete batch (B) scaling in remaining stages + comm
mukesh
2026-07-28 23:10:39 -07:00
-
fc1dcdde24
analytical-viz: tensor sharding — show batch B on KV cache
mukesh
2026-07-28 22:56:48 -07:00
-
fd45bd2408
analytical-viz: add sidebar Batch B selectbox + wire through all suggesters
mukesh
2026-07-28 22:51:56 -07:00
-
674e194dc9
analytical-viz: hot-reload guard — include model_config + model_presets, ordered
mukesh
2026-07-28 22:43:47 -07:00
-
770aed6291
analytical-viz: Auto Suggest tab — add Top-10 by memory footprint table
mukesh
2026-07-28 22:24:38 -07:00
-
1bce080d79
analytical-viz: buttons pick smallest-fit Pareto point, not fastest
mukesh
2026-07-28 22:23:34 -07:00
-
5d7ef48b14
analytical-viz: partial batch (B) scaffold — TopologyConfig field + KV / early stages
mukesh
2026-07-28 22:21:37 -07:00
-
2a0bc26db0
analytical-viz: compound tiebreaker — fewer PEs / lower HBM% when latency ties
mukesh
2026-07-28 22:16:02 -07:00
-
6f61657ba4
analytical-viz: topology map — color PEs by CP rank when cp_placement=pe
mukesh
2026-07-28 22:07:50 -07:00
-
da1909fdf2
analytical-viz: extend hot-reload guard to all viz sub-modules
mukesh
2026-07-28 22:03:42 -07:00
-
ed28eea156
analytical-viz: color-code CP groups in PE layout when cp_placement=pe
mukesh
2026-07-28 21:59:18 -07:00
-
f1cf0257d3
analytical-viz: restore Apply memory-min button
mukesh
2026-07-28 21:55:29 -07:00
-
afe35ee0b5
Revert "analytical-viz: default intra-cube (PE↔PE) BW to 128 GB/s"
mukesh
2026-07-28 21:50:17 -07:00
-
84abf847c4
analytical-viz: default intra-cube (PE↔PE) BW to 128 GB/s
mukesh
2026-07-28 21:44:21 -07:00
-
a7f39ade7e
analytical-viz: autosuggest prefers fewer cubes, tries cp_placement=pe
mukesh
2026-07-28 16:04:17 -07:00
-
c2b42999d8
analytical-viz: reorder tabs — Physical layout back to first
mukesh
2026-07-28 14:26:07 -07:00
-
9afeb6bc16
analytical-viz: 3 sidebar apply-buttons (Attn / FFN / Attn+FFN)
mukesh
2026-07-28 14:24:06 -07:00
-
bccc90db82
analytical-viz: Physical Layout scope filter for stage tables
mukesh
2026-07-28 14:21:27 -07:00
-
1a6d52c58a
analytical-viz: force-reload our modules on Streamlit rerun
mukesh
2026-07-28 14:17:13 -07:00
-
09721040ca
analytical-viz: 3 sweep buttons at top of Physical Layout tab
mukesh
2026-07-28 14:11:30 -07:00
-
bf5b659a3d
analytical-viz: add FFN-only scope + 3rd sweep button
mukesh
2026-07-28 14:09:24 -07:00
-
b8e1a3322f
analytical-viz: attention-only vs attn+FFN via two sweep buttons
mukesh
2026-07-28 13:58:29 -07:00
-
91b63eb9f6
analytical-viz: parallelism sensitivity chart in Auto Explore tab
mukesh
2026-07-28 13:39:51 -07:00
-
55c20bd1a6
analytical-viz: add Auto Hardware Streamlit tab
mukesh
2026-07-28 13:19:13 -07:00
-
6ef09dd6f5
analytical-viz: auto_hardware.py — joint HW×parallelism explore
mukesh
2026-07-28 13:16:40 -07:00
-
2834383700
analytical-viz: add Auto Explore Streamlit tab
mukesh
2026-07-28 13:02:08 -07:00
-
85f6716fc1
analytical-viz: auto_explore.py — 9-knob Pareto search
mukesh
2026-07-28 12:58:10 -07:00
-
09e9331026
topology: set flit_bytes=4096 (was implicit 256 default)
mukesh
2026-07-28 11:35:04 -07:00
-
f9d0077472
router: memoize Dijkstra path lookups
mukesh
2026-07-27 23:39:39 -07:00
-
65f358fdfa
sim: report correct kernel latency under enable_data=False
mukesh
2026-07-27 22:05:39 -07:00
-
9fdde44922
analytical-viz: interactive Streamlit tool for SIP transformer analysis
mukesh
2026-07-26 22:11:33 -07:00
-
ae131aa2af
report(S5.2): explain why dense mapping wins throughput (per-PE efficiency)
ywkang
2026-07-22 17:46:54 -07:00
-
baf22f01ab
plot: extend batch-scaling curves with saturated-throughput ceiling
ywkang
2026-07-22 17:39:13 -07:00
-
13f5cbc317
gqa decode: fix cube_base output-store; measure batch scaling on one SIP
ywkang
2026-07-22 17:37:10 -07:00
-
8c108154a7
plot: fix Fig 16 suptitle to match KV-footprint panel
ywkang
2026-07-22 16:25:50 -07:00
-
711a9a257f
gqa short-context: exclude KV deploy from wall; correct HBM peak; batch scaffold
ywkang
2026-07-22 16:25:04 -07:00
-
cb6d21f145
report(1H): tighten §5 GQA (mapping tie, taxonomy bridge, dedup, Summary)
ywkang
2026-07-22 10:33:56 -07:00
-
d88e6cc72e
report(1H): rebuild main.pdf
ywkang
2026-07-22 10:22:06 -07:00
-
edb30326ce
report(1H): add Agentic Workloads (§6) and HW-Spec Search (§7) sections
ywkang
2026-07-21 15:00:37 -07:00
-
d0db9ff40e
gqa-decode: topology-agnostic reduce + multi-model attention bench
mukesh
2026-07-22 09:45:51 -07:00
-
23a2bc3fb3
gqa-decode-composite: measure primitive hand-tiled (16×16×16) latency
mukesh
2026-07-13 21:49:57 -07:00
-
eec61838b5
sweep+plot: add primitive hand-tiled (16×16×16) variant to Case-6 decode composite study
mukesh
2026-07-13 09:28:57 -07:00
-
f8caf2e16c
report(gqa-short): draft results subsection (mode + composite-tier comparison, 4 figures)
eusonice
2026-06-26 15:58:48 -07:00
-
09e70bd516
test: fix CSV output paths in 3 sweep files (each variant now writes a unique CSV)
eusonice
2026-06-26 15:14:40 -07:00
-
e20e1f7362
plot: merge plot scripts into single plot_short_context.py
eusonice
2026-06-26 15:13:48 -07:00
-
3437d7e079
sweep: 6 short-context CSVs (3 variants x prefill+decode) + 6 wall/util figures
eusonice
2026-06-26 15:11:01 -07:00
-
3da116d40d
adr-0070: gqa short context attention prefill/decode + 3 composite tiers
eusonice
2026-06-24 16:31:50 -07:00
-
f7aa8134b9
test: 3-variant sweep (baseline + composite + composite-fused) for prefill/decode
eusonice
2026-06-24 15:34:21 -07:00
-
a455ae61b4
sim: pin compute outputs and on-chip recv slots for composite operands
eusonice
2026-06-24 15:33:31 -07:00
-
1971ac731c
add three gqa attention kernel variants for short context length
eusonice
2026-06-24 14:46:55 -07:00
-
a98e93110b
short context length composite command
eusonice
2026-06-23 16:32:17 -07:00
-
f08dda3bd4
test short context length attention kernel
eusonice
2026-06-23 16:29:10 -07:00
-
7d90d53d4d
short context length attention kernel
eusonice
2026-06-23 16:19:39 -07:00
-
a4a2683aad
paper(gqa): single-rank decode-streaming study — composite's masked bandwidth win
feat/gqa-composite-commands
ywkang
2026-06-23 19:39:45 -07:00
-
-
faf011dae5
paper(ipcq): regen alternatives figures + comparison plot + allreduce section
ywkang
2026-06-23 19:19:55 -07:00
-
1dade267ff
experiment(gqa-decode): 16x16x16 MAC-block dispatch model
ywkang
2026-06-23 18:24:26 -07:00
-
24c705419e
paper(gqa): two-regime "use of composite commands" — decode + compute-bound prefill
ywkang
2026-06-23 17:04:26 -07:00
-
cd6f0ed91d
feat(gqa): Case-6 composite-command decode variants + on-chip-operand DMA fix
ywkang
2026-06-23 16:07:41 -07:00
-
e9a5c438e3
paper(1H): 6-case GQA long-ctx + IPCQ design alternatives + GEMM terminology
ywkang
2026-06-22 00:55:54 -07:00
-
bb668a3ac3
paper(gqa): derive (m,l,O) AR per-PE cost from kernel topology
mukesh
2026-06-18 15:38:20 -07:00
-
0662c76fa7
paper(ipcq): de-emphasize flow-diagram outer frame so inner flow stands out
mukesh
2026-06-18 15:01:09 -07:00
-
37dc48fd27
paper(ipcq): add latency-model-style flow + stacked architecture diagrams
mukesh
2026-06-18 14:55:59 -07:00
-
7c45047e93
paper(ipcq): swap control-data overlay for latency PNG in figures/
mukesh
2026-06-18 14:06:32 -07:00
-
73e0b315fe
paper(gqa): table cleanup — drop measured-comm column, narrower fig, wrapped title
mukesh
2026-06-18 14:02:42 -07:00
-
1552028c25
paper(ipcq): add IPCQ vs HW alternatives comparative study
mukesh
2026-06-18 13:27:23 -07:00
-
56c51b184a
paper(gqa): refresh 4 decode 6-case PNGs in figures/ with actual 6-case content
mukesh
2026-06-18 11:51:30 -07:00
-
8102ddbe30
paper(gqa): rename long-ctx artifacts to gqa_long_ctx_6cases_* and add 4 decode 6-case charts
mukesh
2026-06-18 11:49:03 -07:00
-
84bb418e1e
gqa(decode): add d_head-TP kernels + measurement runner + figure generators
mukesh
2026-06-18 11:26:05 -07:00
-
dd3337f2e4
paper(gqa): add 6-case KV-sharding figures (analytical + measured)
mukesh
2026-06-18 11:22:57 -07:00
-
b6315c3c90
paper(1H): reflect D8 single-op cost model in §2/§3.4 + figure/diagram regen
ywkang
2026-06-17 15:12:31 -07:00
-
821bbf26a2
gemm(bench): composite-vs-async dispatch comparison harness + single-op-model sweep
ywkang
2026-06-17 15:06:36 -07:00
-
2d8271c981
perf(cost-model): D8 single-op-cmd fast-path (FIXED=8 single-op / 40 composite)
ywkang
2026-06-17 15:04:53 -07:00
-
0c6ca0aaed
paper(gemm): inline §3.1 pipeline-stage chain; drop display equation
ywkang
2026-06-17 10:40:23 -07:00
-
b64c43b947
paper(gemm): drop in-chart titles + subtitles, let LaTeX caption carry that
ywkang
2026-06-17 10:29:13 -07:00
-
e8b7f4f064
paper(gemm): per-PE HBM BW + TFLOPS evaluation plots; unify peak to 8 TFLOP/s
ywkang
2026-06-17 10:24:42 -07:00
-
23992548f7
gemm(perf): fix back-to-back DMA pipelining + tighten analytic model
ywkang
2026-06-17 09:56:05 -07:00