abnormal_activations
Written on May 13th, 2020 by Francisco Fonseca
abnormal_activations
Extend your Keras Nets with non-traditional activation functions.
Activations available:
- alpha_linear
- step
- LeCunSigmoid
- ReSech
- scaled_sigmoid
- penalized_tanh
- trunc_sin
- sin
Code Snippet
from abnormal_activations.abnormal_activations import ActivationFunctions
# alpha_linear = alpha * x
al = ActivationFunctions.alpha_linear
al(0.3, alpha=0.5) # 0.15
al(2., alpha=0.1) # 0.20
Feel free to share!