Stochastic Gradient Descent

For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector  is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the…

Read More

Oscillator phase noise

Oscillators are used in typical radio circuits to drive the mixer used for the up-conversion or down-conversion of the passband transmission. Ideally, the spectrum of the oscillator is expected to have an impulse at the frequency of oscillation with no frequency components else where. However the spectrum of practical oscillators do have spectrum skirts around…

Read More

Deriving PDF of Rayleigh random variable

In the post on Rayleigh channel model, we stated that a circularly symmetric random variable is of the form , where real and imaginary parts are zero mean independent and identically distributed (iid) Gaussian random variables. The magnitude which has the probability density, is called a Rayleigh random variable. Further, the phase is uniformly distributed from…

Read More

Negative Frequency

Last week, I received an email from Mr. Kishore. He was wondering about the physical significance of negative frequency. Does negative frequency really exist? Though I have seen conflicting views on the net (thread in complextoreal.com, thread in comp.dsp), my perspective is that negative frequency exist. The concept of negative frequency helps me a lot…

Read More

GATE-2012 ECE Q38 (communication)

Question 38 on Communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q38. A binary symmetric channel (BSC) has a transition probability of 1/8. If the binary transmit symbol X is such that P(X=0)=9/10, then the probability of error for an optimum receiver will be (A) 7/80 (B) 63/80 (C)…

Read More

GATE-2012 ECE Q15 (communication)

Question 15 on communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q15. A source alphabet consists of N symbols with the probability of the first two symbols being the same. A source encoder increases the probability of the first symbol by a small amount  and decreases that of the…

Read More