a965db7056
- Title: "Hardware-Software Codesign for Grouped-Query Attention on AHBM"
(drop "Attention-Centric LLM Kernels" framing; subtitle pillars removed)
- Authors: Mukesh Garg, Jiyoon Lee, Yangwook Kang
- Affiliation: System Technology Group, AGI Computing Lab — 2026 1H
- Executive Summary rewritten into a tight three-paragraph structure:
(1) GQA motivation + three AHBM architectural requirements (placement,
inter-PE comm, pipelined memory-compute);
(2) three matching HW-SW co-design mechanisms (GQA-aware placement,
PE_IPCQ, composite-command GEMM under PE_SCHEDULER) and headline
results (38% / 25-35% / 78%), closing on efficient HBM-bandwidth use;
(3) broader applicability across the AHBM software stack.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
450 KiB
450 KiB