ywkang
b715002b5a
§2 platform:
- Accuracy promoted from \paragraph to \subsection (sec:accuracy);
it sits at the same heading level as Why / Device / Latency / HW
config and so reads as a first-class component of the platform
description rather than a tail-end footnote.
- Three architecture diagrams (SIP, CUBE, PE) collapsed into one
figure* using subcaption: Fig.~\ref{fig:hw-arch}(a) SIP and (b)
CUBE side-by-side on row 1, (c) PE wide on row 2, total height
capped at ~40% of the page. Subfigure cross-references rewritten
to Fig.~ref{fig:hw-arch}\subref{...} in the body text. main.tex
now pulls in the subcaption package.
- Table 1 (modeled hardware configuration) promoted to table*
(two-column / full page width) and the row layout rewritten as a
4-column tabular so Hierarchy + PE + Command-issue sit on the
left and Memory + Interconnect sit on the right. The previous
single-column rendering was getting cut at the right edge of the
printed column.
§6 GQA:
- Removed the historical four-panel headline table (tab:gqa), the
two figures (fig:gqa-lat, fig:gqa-break), and the prose paragraph
that cited their per-panel numbers. Reason: the underlying
milestone-gqa-headline bench has been simplified in collaborator
commit 65c365f ("drop misleading single_user_/multi_user_
panels") and no longer reproduces that data, so the section was
left referencing a dataset the current bench cannot regenerate.
- The previously-added 4-cases long-context decode comparison is
now §6's only Results subsection, retitled to
"Results: long-context decode and parallelism strategies".
The headline GQA result that survives into the paper is therefore
the parallelism trade-off study (Case 4 / Cube-SP × PE-SP at 34 us
buying an 8x KV-memory reduction over the latency leaders).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
48 lines
1.1 KiB
TeX
48 lines
1.1 KiB
TeX
\documentclass[10pt,twocolumn]{article}
|
|
|
|
\usepackage[margin=0.75in]{geometry}
|
|
\usepackage{graphicx}
|
|
\usepackage{booktabs}
|
|
\usepackage{amsmath}
|
|
\usepackage{amssymb}
|
|
\usepackage{siunitx}
|
|
\DeclareSIUnit\flop{FLOP}
|
|
\DeclareSIUnit\cycle{cycle}
|
|
\DeclareSIUnit\byte{B}
|
|
\usepackage{xcolor}
|
|
\usepackage{hyperref}
|
|
\hypersetup{colorlinks=true,linkcolor=blue!50!black,citecolor=blue!50!black,urlcolor=blue!50!black}
|
|
\usepackage{caption}
|
|
\usepackage{subcaption}
|
|
\captionsetup{font=small,labelfont=bf}
|
|
\usepackage{microtype}
|
|
\usepackage{tikz}
|
|
\usetikzlibrary{arrows.meta,positioning,calc,fit}
|
|
|
|
\graphicspath{{figures/}}
|
|
|
|
\title{\textbf{Hardware--Software Co-Design for Grouped-Query Attention on AHBM}}
|
|
|
|
\author{Mukesh Garg \and Jiyoon Lee \and Yangwook Kang}
|
|
|
|
\date{
|
|
\small
|
|
AGI Computing Lab, System Technology Group\\
|
|
2026 H1 Report
|
|
}
|
|
|
|
\begin{document}
|
|
\maketitle
|
|
|
|
\input{sections/00-exec-summary}
|
|
\input{sections/01-introduction}
|
|
\input{sections/02-platform}
|
|
\input{sections/03-gemm}
|
|
\input{sections/04-allreduce}
|
|
\input{sections/05-gqa}
|
|
\input{sections/06-discussion}
|
|
\input{sections/07-conclusion}
|
|
\input{sections/08-future-work}
|
|
|
|
\end{document}
|