<aside>
💡
Primary Target:
- Building something original which is not discovered or not implemented on opensource yet, which helps the community and build legacy (e.g. EfficientDiffusion or optimized RL etc.)
Secondary Target:
- Implement or use custom Triton codes to accelerate your interest/research area
- Reimplementing famous NNs like FlashAttention, GeGLU/SwiGLU, RoPE etc.)
</aside>
Already implemented:
https://github.com/zinccat/Awesome-Triton-Kernels
https://github.com/linkedin/Liger-Kernel
Search Spaces
Kolmogorov-Arnold Networks (KANs)
State-Space Modlels(SSMs) in RL
Latent Diffusion Model Components
…