| index | name | tags | link |
|---|---|---|---|
| 1 | Triton RMSNorm + Residual | norm | link |
| 2 | Flash-Decoding / Split-KV Attention | attention, decoding | link |
| 3 | Cross entropy loss | loss | link |
| 4 | Geglu | Activation | link |
| 5 | RMSNorm | Normalization | link |
| 6 | Rope Embedding | Embedding | link |
| 7 | Swiglu | Activation | link |
| 8 | Gemm Int4 | Quant, Dequant, Matmul, Gemm | link |
| 9 | Gemm Int8 | Quant, Dequant, Matmul, Gemm | link |
| 10 | Batched Conv2D | Conv | link |
| 11 | Batched Addition | Add | link |
| 12 | Batched Patchng | Rearranging | link |
| 13 | Block-Sparse Matrix Multiplication | Sparsity, Matmul | link |
| 14 | Fused Linear Cross Entropy | Linear Cross Entropy | link |
| n+1 | your contribution | its tags |