Closed form solution for linear regression

In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector  which minimizes the square of the error between the predicted value  and the actual output  for all  values in the training set. A closed form solution for finding the parameter vector  is possible, and in this post…

Read More

Batch Gradient Descent

I happened to stumble on Prof. Andrew Ng’s Machine Learning classes which are available online as part of Stanford Center for Professional Development. The first lecture in the series discuss the topic of fitting parameters for a given data set using linear regression.  For understanding this concept, I chose to take data from the top…

Read More

GATE-2012 ECE Q15 (communication)

Question 15 on communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q15. A source alphabet consists of N symbols with the probability of the first two symbols being the same. A source encoder increases the probability of the first symbol by a small amount  and decreases that of the…

Read More

GATE-2012 ECE Q52 (electromagnetics)

Question 52 on electromagnetics from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. An infinitely long uniform solid wire of radius  carries a uniform dc current of density . Q52. The magnetic field at a distance  from the center of the wire is proportional to (A)  for and for (B)  for  and  for  (C)  for  and  for  (D)  for  and  for  Solution…

Read More

ICCBN 2008, July 17-20 2008, IISc, Bangalore

Advanced Computing and Communication Society (ACS) of India is organizing ICCBN 2008 conference (International Conference on Communication, Convergence, and Broadband Networking) from July 17th to 20th 2008 at National Science Seminar Complex at Indian Institute of Science (IISc), Bangalore. ICCBN Conference aims to provide a premier forum for researchers, industry practitioners and educators to present…

Read More

MIMO with MMSE equalizer

In a previous post, we had discussed a 2×2 MIMO transmission using BPSK modulation in Rayleigh channel with a Zero Forcing equalizer. The simulated results with the 2×2 MIMO system  with zero forcing equalizer showed matching results as obtained in for a 1×1 system for BPSK modulation in Rayleigh channel. In this post, we will…

Read More

GATE-2012 ECE Q47 (math)

Question 47 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q47. Given that and , the value of is (A)  (B)  (C)  (D)  Solution To answer this question, we need to refer to Cayley Hamilton Theorem. This is discussed briefly in Pages 310-311 of Introduction to Linear Algebra, Glibert Strang (buy…

Read More