This my first implementation of gradient descent algorithm in which I will write about the evolution of neural networks. I will start with the most simple network of all, the Single Layer Perceptron, and work through different architectures and learn

Interpolation and fitting, solution of equations, data analysis, University of numerical analysis algorithms, Use of natural gradient algorithm.