Closed form solution for linear regression

In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector  which minimizes the square of the error between the predicted value  and the actual output  for all  values in the training set. A closed form solution for finding the parameter vector  is possible, and in this post…

Read More

Blog on DSP

I happened to visit ‘The Digital Signal Processing Blog’, maintained by Mr. Andres Kwasinski, Ph. D. In the blog one can find details about the upcoming IEEE conferences pertaining to communication and multimedia processing. Further, in some of the posts, author shares his thoughts on topics like fixed point arithmetic (here) and wavelets (here) etc….

Read More

Alamouti STBC

In the recent past, we have discussed three receive diversity schemes – Selection combining, Equal Gain Combining and Maximal Ratio Combining. All the three approaches used the antenna array at the receiver to improve the demodulation performance, albeit with different levels of complexity. Time to move on to a transmit diversity scheme where the information…

Read More

MIMO with MMSE SIC and optimal ordering

This post attempts to build further on the MIMO equalization schemes which we have discussed – (a) Minimum Mean Square Error (MMSE) equalization, (b) Zero Forcing equalization with Successive Interference Cancellation (ZF-SIC) and (c) ZF-SIC with optimal ordering. We have learned that successive interference cancellation with optimal ordering improves the performance with Zero Forcing equalization….

Read More

GATE-2012 ECE Q46 (math)

Question 46 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q46. The maximum value of  in the interval [1, 6] is (A) 21 (B) 25 (C) 41 (D) 46 Solution Let us start by finding the critical points of the function . The first derivative is, . Solving by…

Read More

Chi Square Random Variable

While trying to derive the theoretical bit error rate (BER) for BPSK modulation in a Rayleigh fading channel, I realized that I need to discuss chi square random variable prior. What is chi-square random variable? Let there be independent and identically distributed Gaussian random variables with mean and variance and we form a new random…

Read More