ywkang
d5267ec718
- §1 Introduction rewritten with AHBM-first opening, in-paper KernBench platform overview, GQA motivation and three architectural requirements, three matching HW-SW co-design mechanisms (GQA-aware placement, PE_IPCQ, composite-command GEMM under PE_SCHEDULER), broader- applicability outlook (PE_IPCQ as collective substrate, composite command for fused operator pipelines), and outline. Consistent with the Executive Summary structure. - Executive Summary: extended broader-applicability closing with a forward-looking line previewing FFN/MoE integration. - §5 section heading renamed from "All-Reduce Acceleration via PE_IPCQ" to "PE_IPCQ and Collective Communication". - Title page date line refined to "2026 H1 Report". Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
45 lines
1.0 KiB
TeX
45 lines
1.0 KiB
TeX
\documentclass[10pt,twocolumn]{article}
|
|
|
|
\usepackage[margin=0.75in]{geometry}
|
|
\usepackage{graphicx}
|
|
\usepackage{booktabs}
|
|
\usepackage{amsmath}
|
|
\usepackage{amssymb}
|
|
\usepackage{siunitx}
|
|
\DeclareSIUnit\flop{FLOP}
|
|
\DeclareSIUnit\cycle{cycle}
|
|
\DeclareSIUnit\byte{B}
|
|
\usepackage{xcolor}
|
|
\usepackage{hyperref}
|
|
\hypersetup{colorlinks=true,linkcolor=blue!50!black,citecolor=blue!50!black,urlcolor=blue!50!black}
|
|
\usepackage{caption}
|
|
\captionsetup{font=small,labelfont=bf}
|
|
\usepackage{microtype}
|
|
|
|
\graphicspath{{figures/}}
|
|
|
|
\title{\textbf{Hardware--Software Co-Design for Grouped-Query Attention on AHBM}}
|
|
|
|
\author{Mukesh Garg \and Jiyoon Lee \and Yangwook Kang}
|
|
|
|
\date{
|
|
\small
|
|
AGI Computing Lab, System Technology Group\\
|
|
2026 H1 Report
|
|
}
|
|
|
|
\begin{document}
|
|
\maketitle
|
|
|
|
\input{sections/00-exec-summary}
|
|
\input{sections/01-introduction}
|
|
\input{sections/02-platform}
|
|
\input{sections/03-gemm}
|
|
\input{sections/04-allreduce}
|
|
\input{sections/05-gqa}
|
|
\input{sections/06-discussion}
|
|
\input{sections/07-conclusion}
|
|
\input{sections/08-future-work}
|
|
|
|
\end{document}
|