- auto
A different referee
Everything before this was practice under your own referee. The capstone changes the referee: a kernel is done when it is correct under a differential suite, competitive against both the XLA floor and the hand-tuned ceiling, and reviewed by people who maintain kernels for a living. Upstream review is the only test that cannot be gamed, and what it changes about your code is part of the artifact.
Pick a real gap
Pick a gap that is real: an attention variant no fast public TPU kernel covers, a block-size autotuning pass for an existing Tokamax kernel with measured wins across a shape sweep, or a JAXBench entry on an operator where published baselines trail the expert bound. Sized right, this is four weeks: one derivation, one forward, one backward, one review cycle.
The write-up is the artifact
The write-up matters as much as the merge. Derivation, schedule decisions with their measured consequences, the full benchmark record with provenance, and what review changed: that document is the proof that the fourteen weeks produced an engineer, and it closes the track in public, where it started.
What gets built
- One kernel closing a real gap: an uncovered attention variant, an autotuning pass, or a benchmark entry
- Forward and backward, differential-tested, corner cases enumerated
- Benchmarked against the XLA floor and the hand-tuned ceiling, recorded in bench/
- Sent upstream, review discussion linked from this site
Readings
The work, in order
weeks 11-14
- Week 11: pick the gap, write the derivation and the plan, open the conversation upstream early
- Week 12: forward, differential-tested; first benchmark sweep against floor and ceiling
- Week 13: backward via custom_vjp; corner cases enumerated; bench records land in the repo
- Week 14: the upstream PR, the review cycle, and the capstone write-up as the track finale
Can you
The gate
| criterion | measured |
|---|---|
| Correct under the differential suite | awaiting bench data |
| Beats XLA decisively at target shapes, within striking distance of the hand-tuned ceiling | awaiting bench data |
| The upstream submission exists in public | awaiting bench data |
Public artifact for this stage: The capstone write-up: derivation, schedule decisions, full benchmark record, what review changed.