report(1H): add Agentic Workloads (§6) and HW-Spec Search (§7) sections

- §6 Supporting Agentic Workloads: how the fused GQA design extends to
  agentic fan-out/fan-in; three-layer split (framework/runtime/kernel);
  Stationary-KV vs Distributed-Q execution policies.
- §7 Hardware Performance-Spec Search for GQA: WIP stub (sweep intent
  over GEMM TFLOPS, MATH-engine ALUs, CUBE↔CUBE and SIP↔SIP BW).
- Renumber Discussion/Conclusion/Future-Work to 08/09/10; update
  main.tex input order and toc.md.
- Add Agentic_Runtime_Architecture.md design note; rebuild main.pdf.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
2026-07-21 15:00:37 -07:00
parent d0db9ff40e
commit edb30326ce
9 changed files with 1268 additions and 20 deletions
+18 -7
View File
@@ -45,17 +45,28 @@
6. **Fused Grouped Query Attention** (composite + PE_IPCQ) — `sections/05-gqa.tex`
necessity · design · results · analysis. (+ GQA seq/head/user configs)
7. **Discussion**`sections/06-discussion.tex`
7. **Supporting Agentic Workloads**`sections/06-agentic.tex`
How the §6 GQA design extends to agentic fan-out/fan-in: shared-prefix KV
reuse, batched replicated-Q attention, schema/pointer-based fan-in.
Implementation split across three levels (agentic framework / runtime /
kernel) with each component's responsibilities. Design, not yet measured.
8. **Hardware Performance-Spec Search for GQA**`sections/07-hw-spec-search.tex`
*Work in progress.* Joint sweep of GEMM TFLOPS, MATH-engine ALU count,
CUBE↔CUBE (die-to-die) BW, SIP↔SIP (card-to-card) BW to find the balanced
spec for GQA. Intent + method only; data/figures/conclusions deferred.
9. **Discussion**`sections/08-discussion.tex`
Which HW changes are meaningful, and under what regimes (cross-cutting).
8. **Conclusion**`sections/07-conclusion.tex`
The codesign thesis, stated plainly, supported by the measured results.
10. **Conclusion**`sections/09-conclusion.tex`
The codesign thesis, stated plainly, supported by the measured results.
9. **Future Work — 2H**`sections/08-future-work.tex`
Add the FFN/MoE layer toward full LLM decoding; how compute & data should
be distributed for agentic / MoE workloads.
11. **Future Work — 2H**`sections/10-future-work.tex`
Add the FFN/MoE layer toward full LLM decoding; how compute & data should
be distributed for agentic / MoE workloads.
10. **References** *(optional)* — external literature only (FlashAttention,
12. **References** *(optional)* — external literature only (FlashAttention,
Megatron-LM, GPT-3, Llama 3). No ADR/SPEC entries.
## Per-section structure (§4/§5/§6)