Link: https://github.com/unslothai/unsloth/blob/main/unsloth/kernels/geglu.py
Author: Daniel Han-Chen & the Unsloth team
Tags: Activation
Description:
- exact geglu forward
- exact geglu backward
- approximate (faster) geglu forward
- approximate (faster) geglu backward
Triton Version: ?
Other Notes:
-
Id in triton index: 0004