For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the…
In problem 9.14 of DSP-Proakis, the objective is to analyze the effect of zero-order interpolation and first-order interpolation to double the number of samples in the sinusoidal while keeping the sampling frequency unchanged. My take: The first part of the problem (a) is to generate the sequence having half the frequency of . For zero-order…
In the previous post on transmit filtering using Nyquist pulse, we had briefly learned that the information symbol with a symbol period can be transmitted without inter symbol interference (ISI) by using Nyquist pulse, . The resultant waveform is ideally bandlimited to frequencies from Hz to Hz. However, in typical transmission schemes, we do not…
In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector which minimizes the square of the error between the predicted value and the actual output for all values in the training set. A closed form solution for finding the parameter vector is possible, and in this post…
Considering a typical scenario where there might exist a small phase offset between local oscillator between the transmitter and receiver. Figure 1 : Transmitter receiver with constant phase offset In such cases, it might be desirable to estimate and track the phase offset such that the performance of the receiver does not degrade.
This is the first post in the series discussing receiver diversity in a wireless link. Receiver diversity is a form of space diversity, where there are multiple antennas at the receiver. The presence of receiver diversity poses an interesting problem – how do we use ‘effectively‘ the information from all the antennas to demodulate the…
My friend Mr. Balaji volunteers for Vibha, a non-profit organization whose mission is to ensure that every underprivileged child attains his or her right to education, health and opportunity. Vibha, which was founded in 1991 has a volunteer network of 825 members spread across Atlanta, Austin, Bay Area, Boston, Chicago, Dallas, Houston, Jacksonville, Los Angeles,…
In this post, let us try to understand Gray codes and their usage in digital communication. Quoting from Wiki entry on Gray code [Gray-Wiki], The reflected binary code, also known as Gray code after Frank Gray, is a binary numeral system where two successive values differ in only one digit. In a digital communication system,…
A friend called me up couple of days back with the question – How white is AWGN? I gave him an answer over phone, which he was not too happy about. That got me thinking bit more on the topic and the result is this post – brief write up on thermal noise and it’s…
Being not too happy with the speed of the shared hosting, decided to move the blog to an Amazon Elastic Compute Cloud (Amazon EC2) instance. Given this is a baby step, picked up a micro instance running an Ubuntu server and installed Apache web server, MySQL, PHP . After doing a bit of tweaking with this new…
In a previous post, the variance of the in-band quantization noise for a first order sigma delta modulator was derived. Taking it one step furhter, let us find the variance of the quantization noise filtered by a second order filter. With a first order filter, the quantization noise passes through a system with transfer function…
Following the discussion on thermal noise and it’s modeling and noise figure computation for a simple resistor network, in this article let us discuss the Noise Figure of cascaded stages.
We had discussed three Single Input Multiple Output (SIMO also known as receive diversity) schemes – Selection combining, Equal Gain Combining, Maximal Ratio Combining and a Multiple Input Single Output (MISO, also known as transmit diversity) scheme – Alamouti 2×1 STBC. Let us now discuss the case where there a multiple transmit antennas and multiple…
We have quite a few articles discussing bit and symbol error rates for popular digital modulation schemes in Additive White Gaussian Noise (AWGN) channel. This post summarizes the articles discussing the theoretical and simulated error rates for the digital modulation schemes like BPSK, QPSK, 4–PAM, 16PSK and 16QAM. Further, Bit Error Rate with Gray coded…