ywkang
a965db7056
- Title: "Hardware-Software Codesign for Grouped-Query Attention on AHBM"
(drop "Attention-Centric LLM Kernels" framing; subtitle pillars removed)
- Authors: Mukesh Garg, Jiyoon Lee, Yangwook Kang
- Affiliation: System Technology Group, AGI Computing Lab — 2026 1H
- Executive Summary rewritten into a tight three-paragraph structure:
(1) GQA motivation + three AHBM architectural requirements (placement,
inter-PE comm, pipelined memory-compute);
(2) three matching HW-SW co-design mechanisms (GQA-aware placement,
PE_IPCQ, composite-command GEMM under PE_SCHEDULER) and headline
results (38% / 25-35% / 78%), closing on efficient HBM-bandwidth use;
(3) broader applicability across the AHBM software stack.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
45 lines
1.0 KiB
TeX
45 lines
1.0 KiB
TeX
\documentclass[10pt,twocolumn]{article}
|
|
|
|
\usepackage[margin=0.75in]{geometry}
|
|
\usepackage{graphicx}
|
|
\usepackage{booktabs}
|
|
\usepackage{amsmath}
|
|
\usepackage{amssymb}
|
|
\usepackage{siunitx}
|
|
\DeclareSIUnit\flop{FLOP}
|
|
\DeclareSIUnit\cycle{cycle}
|
|
\DeclareSIUnit\byte{B}
|
|
\usepackage{xcolor}
|
|
\usepackage{hyperref}
|
|
\hypersetup{colorlinks=true,linkcolor=blue!50!black,citecolor=blue!50!black,urlcolor=blue!50!black}
|
|
\usepackage{caption}
|
|
\captionsetup{font=small,labelfont=bf}
|
|
\usepackage{microtype}
|
|
|
|
\graphicspath{{figures/}}
|
|
|
|
\title{\textbf{Hardware--Software Co-Design for Grouped-Query Attention on AHBM}}
|
|
|
|
\author{Mukesh Garg \and Jiyoon Lee \and Yangwook Kang}
|
|
|
|
\date{
|
|
\small
|
|
AGI Computing Lab, System Technology Group\\
|
|
H1 2026
|
|
}
|
|
|
|
\begin{document}
|
|
\maketitle
|
|
|
|
\input{sections/00-exec-summary}
|
|
\input{sections/01-introduction}
|
|
\input{sections/02-platform}
|
|
\input{sections/03-gemm}
|
|
\input{sections/04-allreduce}
|
|
\input{sections/05-gqa}
|
|
\input{sections/06-discussion}
|
|
\input{sections/07-conclusion}
|
|
\input{sections/08-future-work}
|
|
|
|
\end{document}
|