Where the rows go

Every other layer

Last feed-forward block

Computed and used Computed, then thrown away The row that picks the move Padding

Fresh rows 64-row tiles per layer Padded slots

1 cell = 1 token row · 346-token prompt · M1 Max, native wgpu · timings from different sessions aren't comparable with each other