Where SiLU runs

Paired projection (the stretch) saves
Down projection (the squash) · 32 groups of 32 outputsevery group needs all 2560 hidden numbers

Counts are per token, for 1 feed-forward block · 346-token prompt · M1 Max, native wgpu · output scores were bitwise identical across all 3