gqa: reorganize benches into gqa_helpers/ subpackage; drop legacy headline

Browse Source

Splits the GQA helpers into a dedicated subpackage to make room for the
prefill 4-cases study (next commit) and a single umbrella bench
(milestone-1h-gqa, after that).

Layout:
  benches/gqa_helpers/
    long_ctx/    — decode 4-cases kernels + sweep runner
    short_ctx/   — prefill/decode short-context kernels
    shared/      — _gqa_panel_helpers + decode_opt2 (context-agnostic)

The registry audit now skips subpackages so gqa_helpers/ (without a
leading underscore) doesn't get audited for @bench decorators.

Also drops the legacy milestone-gqa-headline bench, its
_gqa_attention_prefill_long kernel, 6 dependent prefill tests, the
paper_gqa_latency.py report harness, and the 3 stale headline-derived
PNGs the §6 wire-up referenced (paper will re-pull from the new
1H_milestone_output/gqa/long_ctx/ once §6 is updated).

The _ccl_cfg and _summarize_op_log helpers used to live in the
headline bench; extracted them to gqa_helpers/shared/_gqa_panel_helpers.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

...

This commit is contained in:

Mukesh Garg

2026-06-16 13:05:41 -07:00

parent 359a0eaa44

commit e45626c036

32 changed files with 178 additions and 1674 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

docs/report/1H-codesign-paper/figures/gqa_decode_long_ctx_4cases_latency.png

BIN

Binary file not shown.

Side by Side Before Width:  |  Height:  |  Size: 47 KiB

docs/report/1H-codesign-paper/figures/gqa_decode_long_ctx_4cases_memory.png

BIN

Binary file not shown.

Side by Side Before Width:  |  Height:  |  Size: 42 KiB

docs/report/1H-codesign-paper/figures/gqa_decode_long_ctx_4cases_traffic.png

BIN

Binary file not shown.

Side by Side Before Width:  |  Height:  |  Size: 41 KiB