ywkang
edb30326ce
- §6 Supporting Agentic Workloads: how the fused GQA design extends to agentic fan-out/fan-in; three-layer split (framework/runtime/kernel); Stationary-KV vs Distributed-Q execution policies. - §7 Hardware Performance-Spec Search for GQA: WIP stub (sweep intent over GEMM TFLOPS, MATH-engine ALUs, CUBE↔CUBE and SIP↔SIP BW). - Renumber Discussion/Conclusion/Future-Work to 08/09/10; update main.tex input order and toc.md. - Add Agentic_Runtime_Architecture.md design note; rebuild main.pdf. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
50 lines
1.2 KiB
TeX
50 lines
1.2 KiB
TeX
\documentclass[10pt,twocolumn]{article}
|
|
|
|
\usepackage[margin=0.75in]{geometry}
|
|
\usepackage{graphicx}
|
|
\usepackage{booktabs}
|
|
\usepackage{amsmath}
|
|
\usepackage{amssymb}
|
|
\usepackage{siunitx}
|
|
\DeclareSIUnit\flop{FLOP}
|
|
\DeclareSIUnit\cycle{cycle}
|
|
\DeclareSIUnit\byte{B}
|
|
\usepackage{xcolor}
|
|
\usepackage{hyperref}
|
|
\hypersetup{colorlinks=true,linkcolor=blue!50!black,citecolor=blue!50!black,urlcolor=blue!50!black}
|
|
\usepackage{caption}
|
|
\usepackage{subcaption}
|
|
\captionsetup{font=small,labelfont=bf}
|
|
\usepackage{microtype}
|
|
\usepackage{tikz}
|
|
\usetikzlibrary{arrows.meta,positioning,calc,fit}
|
|
|
|
\graphicspath{{figures/}}
|
|
|
|
\title{\textbf{Hardware--Software Co-Design for Grouped-Query Attention on AHBM}}
|
|
|
|
\author{Mukesh Garg \and Jiyoon Lee \and Yangwook Kang}
|
|
|
|
\date{
|
|
\small
|
|
AGI Computing Lab, System Technology Group\\
|
|
2026 Q1-Q3 Report
|
|
}
|
|
|
|
\begin{document}
|
|
\maketitle
|
|
|
|
\input{sections/00-exec-summary}
|
|
\input{sections/01-introduction}
|
|
\input{sections/02-platform}
|
|
\input{sections/03-gemm}
|
|
\input{sections/04-allreduce}
|
|
\input{sections/05-gqa}
|
|
\input{sections/06-agentic}
|
|
\input{sections/07-hw-spec-search}
|
|
\input{sections/08-discussion}
|
|
\input{sections/09-conclusion}
|
|
\input{sections/10-future-work}
|
|
|
|
\end{document}
|