MS student, Albert-Ludwigs-Universität Freiburg
1 paper at NeurIPS 2025
We introduce the Gompertz Linear Unit (GoLU), a novel self-gated activation function with superior performance on a diverse range of tasks.