Impact of the Initialization and the Activation function on the training of deep Neural Networks
In this repository, you find the code for :
- Finding the Edge of Chaos Initialization for a given activation function
- Simulation with different Initializations/activations
- Plotting code