OpenCV supports ReLU, ELU, and several other activation functions. I would like to implement a relatively recently published activation function called SELU (Scaled Exponential Linear Unit, https://arxiv.org/abs/1706.02515) which has been shown to have several nice properties leading to better learning networks.