Books

Happy holidays! 🙂 Wishing every one merry Christmas and a great year 2009 and beyond. I will list down some of the books which I have on my desk. They help me with the math and simulations Digital Communication: Third Edition, by John R. Barry, Edward A. Lee, David G. Messerschmitt

Read More

Happy New Year 2010

Wishing all the readers of dsplog.com a great year 2010 ! Its been a mixed year for dsplog. Some key milestones a) Crossing 1000 subscribers with 1100+ comments in March 2009 b) Crossing 100 posts with 2200 subscribers and 2600+ comments in October 2009 c) As I write this, we have 102 posts with 2603…

Read More

Batch Gradient Descent

I happened to stumble on Prof. Andrew Ng’s Machine Learning classes which are available online as part of Stanford Center for Professional Development. The first lecture in the series discuss the topic of fitting parameters for a given data set using linear regression.  For understanding this concept, I chose to take data from the top…

Read More

Stochastic Gradient Descent

For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector  is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the…

Read More

GATE-2012 ECE Q47 (math)

Question 47 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q47. Given that and , the value of is (A)  (B)  (C)  (D)  Solution To answer this question, we need to refer to Cayley Hamilton Theorem. This is discussed briefly in Pages 310-311 of Introduction to Linear Algebra, Glibert Strang (buy…

Read More

GATE-2012 ECE Q11 (signals)

Question 11 on signals from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q11. The unilateral Laplace transform of is . The unilateral Laplace transform ofis (A)  (B)  (C)  (D)  Solution From the definition of Laplace transform for a function defined for all real numbers  is,  , where  with real numbers  and . To find the Laplace…

Read More

Viterbi decoder

Coding is a technique where redundancy is added to original bit sequence to increase the reliability of the communication. Lets discuss a simple binary convolutional coding scheme at the transmitter and the associated Viterbi (maximum likelihood) decoding scheme at the receiver. Update: For some reason, the blog is unable to display the article which discuss…

Read More