Files
kernbench2/tests/test_tl_copy_to.py
T
mukesh d282144339 gqa: ADR-0060/0062/0063/0064 unified GQA kernels + CPU cost model
Land the new GQA fused-attention kernels (ADR-0060) for prefill/decode
across long and short context, the TL discipline primitives they depend
on (ADR-0062 lazy load, ADR-0063 scratch_scope + copy_to), and the
per-op-type CPU issue cost model (ADR-0064). Remove the pre-ADR-0060
mesh-attention baseline now that the unified kernels supersede it.

ADR-0060 (long context)
- _gqa_decode.py: M-fold + 2-level chain reduce-to-root (Level-2
  intra-CUBE row-then-col + Level-1 inter-CUBE) — root-only output.
- _gqa_prefill.py: head-parallel + Ring KV rotation around C CUBEs,
  online-softmax merge per ring step, per-CUBE distributed output.
- Each merge stage wraps in scratch_scope() and persists running
  (m, l, O) via copy_to() to lift the 1 MiB scratch ceiling.

ADR-0060 §B.split.2 (short context, kv_per_cube in {1,2,4,8})
- _gqa_decode_short.py / _gqa_prefill_short.py: no cube-SP; each CUBE
  owns whole KV heads; PE-parallel heads with intra-group chain
  reduce. Prefill has no Ring KV (each head fully resident).

ADR-0062 (lazy tl.load): future-bearing TensorHandle, auto-wait at
first consuming op (dot/MATH/store/send/copy_to/composite).

ADR-0063 (tl.scratch_scope + tl.copy_to): scoped per-tile arena with
copy_to writeback primitive for persistent running state.

ADR-0064 (CPU issue cost model)
- common/cpu_issue_cost.py: per-op-type table (composite=40 ns,
  primitives=5 ns); ratios are load-bearing per D1.
- TLContext: issue_cost_table param; _emit_dispatch_overhead(kind)
  consults table with dispatch_cycles fallback (ADR-0046 §D6
  back-compat).
- Live PE_CPU paths (greenlet + legacy) construct TLContext with
  DEFAULT_CPU_ISSUE_COST so saturation lever (ADR-0060 §1) is
  measurable end-to-end.

P7 headline bench: milestone-gqa-headline writes per-panel
op_log_summary to 1H_milestone_output/gqa_headline/sweep.json. No
figure renderers yet (deferred).

Removals (pre-ADR-0060 baseline now superseded):
- benches: _attention_mesh_kv.py, _attention_mesh_mlo.py,
  _attention_mesh_mlo_2d.py, milestone_gqa_llama70b.py
- tests: test_attention_*, test_mesh_*, test_milestone_gqa_llama70b
- topology: llama70b_4sip.yaml (only consumer was the deleted diag)
- artifacts: 1H_milestone_output/gqa/ (sweep.json + 5 PNGs)
- tests/gqa/ plot helper + test (broken on Windows Tcl/Tkinter)
- ADR-0060/0061 references to deleted file paths cleaned up
  (EN + KO kept in sync).

Tests: 124/124 focused regression green (attention + Phase E + TL
discipline + triton_emu + pe_components). Full regression: 764 pass,
2 pre-existing test_bench_registry failures (stale EXPECTED_NAMES
across multiple benches, not introduced here).

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-06-09 18:15:59 -07:00

167 lines
6.3 KiB
Python

"""Phase 1 spec test for ``tl.copy_to`` (ADR-0063 §D3.1).
ADR-0063 §D3.1: ``tl.copy_to(dst, src)`` is a TCM-to-TCM byte copy that
lets a kernel write a scoped result's bytes to a persistent (outside-
scope) address. Required for the two-arena flash pattern in §D3.
Emit-time validation (ADR-0063 §D3.1 "Mechanics" / "Emit-time validation"):
- ``dst.shape == src.shape``
- ``dst.dtype == src.dtype``
- ``dst.space == "tcm"`` (TCM-only — HBM goes through ``tl.store``)
- ``src.space == "tcm"`` (same reason)
op_log shape (ADR-0063 §D3.1 "Mechanics"):
- ``op_kind="math"`` (runs on the vector engine)
- ``op_name="copy"``
Phase 1 (this commit): tests only — production code lands in Phase 2.
The tests are written against the ``CopyCmd`` dataclass and the
``TLContext.copy_to`` method that ADR-0063 §D3.1 declares; both are
absent today, so every test in this file should currently fail with
``AttributeError`` / ``ImportError``.
"""
from __future__ import annotations
import pytest
from kernbench.triton_emu.tl_context import TLContext
def _ctx() -> TLContext:
"""TLContext with a real scratch base so _make_compute_out allocates."""
return TLContext(
pe_id=0, num_programs=1, dispatch_cycles=0,
scratch_base=1 << 24, scratch_size=1 << 20,
)
# ── 1. Method exists on the tl surface ───────────────────────────────
def test_copy_to_method_exists():
"""ADR-0063 §D3.1: TLContext must expose ``copy_to(dst, src)``."""
ctx = _ctx()
assert hasattr(ctx, "copy_to"), (
"TLContext must expose copy_to(dst, src) per ADR-0063 §D3.1"
)
# ── 2. Emits a CopyCmd with the documented fields ────────────────────
def test_copy_to_emits_copy_command():
"""ADR-0063 §D3.1 Mechanics: a new ``CopyCmd(src, dst, nbytes)``
command is recorded; data_op=True (so it appears in op_log)."""
from kernbench.common.pe_commands import CopyCmd # added in Phase 2
ctx = _ctx()
src = ctx._make_compute_out(shape=(8, 64), dtype="f16")
dst = ctx._make_compute_out(shape=(8, 64), dtype="f16")
ctx.copy_to(dst, src)
copy_cmds = [c for c in ctx.commands if isinstance(c, CopyCmd)]
assert len(copy_cmds) == 1, (
f"exactly one CopyCmd expected; got {len(copy_cmds)}"
)
cmd = copy_cmds[0]
assert cmd.src is src
assert cmd.dst is dst
assert cmd.nbytes == 8 * 64 * 2
assert cmd.data_op is True
# ── 3. Shape mismatch is rejected at emit time ───────────────────────
def test_copy_to_shape_mismatch_rejected():
"""ADR-0063 §D3.1: ``dst.shape == src.shape`` enforced at emit time."""
ctx = _ctx()
src = ctx._make_compute_out(shape=(8, 64), dtype="f16")
dst = ctx._make_compute_out(shape=(8, 128), dtype="f16") # mismatched
with pytest.raises((ValueError, AssertionError)) as excinfo:
ctx.copy_to(dst, src)
assert "shape" in str(excinfo.value).lower()
# ── 4. Dtype mismatch is rejected at emit time ───────────────────────
def test_copy_to_dtype_mismatch_rejected():
"""ADR-0063 §D3.1: ``dst.dtype == src.dtype`` enforced at emit time."""
ctx = _ctx()
src = ctx._make_compute_out(shape=(8, 64), dtype="f16")
dst = ctx._make_compute_out(shape=(8, 64), dtype="f32") # mismatched
with pytest.raises((ValueError, AssertionError)) as excinfo:
ctx.copy_to(dst, src)
assert "dtype" in str(excinfo.value).lower()
# ── 5. Non-TCM dst is rejected at emit time ──────────────────────────
def test_copy_to_dst_must_be_tcm():
"""ADR-0063 §D3.1: ``dst.space == 'tcm'`` enforced at emit time.
Writing to HBM goes through ``tl.store``, not ``tl.copy_to`` —
keeping copy_to TCM-only avoids polluting op_log with DMA entries
that the bump-allocator scope mechanism doesn't model.
"""
ctx = _ctx()
src = ctx._make_compute_out(shape=(8, 64), dtype="f16")
# Fabricate an HBM-resident dst (e.g. a load handle).
dst_hbm = ctx.load(0x10_000, shape=(8, 64), dtype="f16")
assert dst_hbm.space == "hbm", "fixture sanity check"
with pytest.raises((ValueError, AssertionError)) as excinfo:
ctx.copy_to(dst_hbm, src)
msg = str(excinfo.value).lower()
assert "tcm" in msg or "space" in msg or "hbm" in msg
# ── 6. Non-TCM src is rejected at emit time ──────────────────────────
def test_copy_to_src_must_be_tcm():
"""ADR-0063 §D3.1: src.space == 'tcm' (symmetric to dst).
Reading from HBM goes through ``tl.load``, not ``tl.copy_to``.
"""
ctx = _ctx()
src_hbm = ctx.load(0x10_000, shape=(8, 64), dtype="f16")
assert src_hbm.space == "hbm"
dst = ctx._make_compute_out(shape=(8, 64), dtype="f16")
with pytest.raises((ValueError, AssertionError)) as excinfo:
ctx.copy_to(dst, src_hbm)
msg = str(excinfo.value).lower()
assert "tcm" in msg or "space" in msg or "hbm" in msg
# ── 7. op_log routes CopyCmd as ("math", "copy", ...) ────────────────
def test_copy_to_op_log_classifies_as_math_copy():
"""ADR-0063 §D3.1 Mechanics: op_kind='math', op_name='copy'.
The vector engine handles the copy; op_log classification reflects
that (engine-class accounting in bench summaries can sum over
op_kind='math' to include copy time alongside softmax/exp).
"""
from kernbench.common.pe_commands import CopyCmd # added in Phase 2
from kernbench.sim_engine.op_log import _extract_op_info
ctx = _ctx()
src = ctx._make_compute_out(shape=(8, 64), dtype="f16")
dst = ctx._make_compute_out(shape=(8, 64), dtype="f16")
ctx.copy_to(dst, src)
cmd = next(c for c in ctx.commands if isinstance(c, CopyCmd))
op_kind, op_name, params = _extract_op_info(cmd)
assert op_kind == "math", (
f"copy runs on the vector engine: op_kind='math'; got {op_kind!r}"
)
assert op_name == "copy", (
f"op_name must be 'copy' per ADR-0063 §D3.1; got {op_name!r}"
)
# Params must let DataExecutor replay (read src, write dst).
assert params.get("dst_addr") == dst.addr
assert params.get("dst_space", "tcm") == "tcm"