December 2011 - DSP LOG

Newton’s method to find square root, inverse

Krishna Sankar13 years ago13 years ago16 mins

Some of us would have used Newton’s method (also known as Newton-Raphson method) in some form or other. The method has quite a bit of history, starting with the Babylonian way of finding the square root and later over centuries reaching the present recursive way of finding the solution. In this post, we will describe…

Closed form solution for linear regression

Krishna Sankar14 years ago9 months ago101 mins

In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector which minimizes the square of the error between the predicted value and the actual output for all values in the training set. A closed form solution for finding the parameter vector is possible, and in this post…