A compile-time stdlib-less activation function library.

• Sigmoid and Related Activation Functions:

  • Sigmoid
  • Softmax

• ReLU and Related Activation Functions:

  • Linear Variants:

    • ReLU
    • Leaky ReLU
    • Parametric ReLU

  • Non-linear Variants:

    • GELU
    • SiLU
    • ELU
    • Softplus
    • Mish

• Other Activation Functions:

  • Identity
  • Binary Step
  • tanh
  • Gaussian
  • Growing Cosine Unit

#include "fun.hpp"

int main() {
  auto z = softplus(1.2);
  std::cout << z << '\n';
}

$ mkdir build
$ cd build
$ cmake -DCOMPILER=clang -DCMAKE_BUILD_TYPE=Release -DCMAKE_TOOLCHAIN_FILE=VCPKG_TOOLCHAIN_FILE ..
$ cmake --build .

• Activation function

MIT License