Deriving Taylor Series for Deep Learning Activation Functions
We derive Taylor Polynomials for the Hyperbolic Tangent, Sigmoid, and Exponential Linear Unit Deep Learning Activation Functions in order to use them in the video bellow to improve training performance and decrease training time: video coming out tommorow TIMESTAMPS: 0:00 What are Activation Functions 0:15 What We re Trying to Do 1:16 Hyperbolic Tangent 2:00 Exponential Linear Unit 3:42 Sigmoid 6:40 Next Steps
|
|