Let us try to understand the formula for Channel Capacity with an Average Power Limitation, described in Section 25 of the landmark paper A Mathematical Theory for Communication, by Mr. Claude Shannon. Further, the following writeup is based on Section 12.5.1 from Fundamentals of Communication Systems by John G. Proakis, Masoud Salehi
In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector which minimizes the square of the error between the predicted value and the actual output for all values in the training set. A closed form solution for finding the parameter vector is possible, and in this post…
In two previous posts, we have derived theoretical symbol error rate for 16-QAM and 16-PSK modulation schemes. The links are: (a) Symbol error rate for 16-PSK (b) Symbol error rate for 16-QAM Given that we are transmitting the same number of constellation points in both 16-PSK and 16-QAM, let us try to understand the better…
In a classification problem, the output (also called the label or class) takes a small number of discrete values rather than continuous values. For a simple binary classification problem, where output takes only two discrete values : 0 or 1, the sigmoid function can be used to transform the output of a linear regression model…
Given that we have discussed Binary to Gray code conversion, let us discuss the Gray to BInary conversion. Conversion from Gray code to natural Binary Let be the equivalent Gray code for an bit binary number with representing the index of the bit. 1. For , i.e, the most significant bit (MSB) of the Gray…
This is the third post in the series discussing receiver diversity in a wireless link. Receiver diversity is a form of space diversity, where there are multiple antennas at the receiver. The presence of receiver diversity poses an interesting problem – how do we use ‘effectively‘ the information from all the antennas to demodulate the…
In an earlier post, it was mentioned that delta modulator without the quantizer is identical to convolving an input sequence with . Let us first try to validate that thought using a small MATLAB example and using the delta modulator circuit shown in Figure 9.13a of DSP-Proakis [1]. % delta modulation xn = sin(2*pi*1/64*[0:63]); xhatn…
As on 21st October 2007, we moved from blogspot domain at to the self hosted domain at https://dsplog.com. Over the last two years, the blog has grown quite a bit, and am reasonably happy with the progress. Let us look back at the positives and negatives over the last year.
Understanding gradients is essential in machine learning, as they indicate the direction and rate of change in the loss function with respect to model parameters. This post covers the gradients for the vanilla Linear Regression case taking two loss functions Mean Square Error (MSE) and Mean Absolute Error (MAE) as examples. The gradients computed analytically…
We have installed Google FriendConnect on dspLog.com. With Google Friend Connect, you can: (a) You can interact with other members who have similiar interests. You will come to know the list of other sites (apart from dspLog.com) where the members have joined. You can add a member as a friend and so on. (b) You…
Equivalence of Moving Average and CIC filter Let me briefly share my understanding on the cascaded integrator comb (CIC) filter, thanks to the nice article. For understanding the cascaded integrator comb (CIC) filter, firstly let us understand the moving average filter, which is accumulation latest samples of an input sequence .
Let us try to understand peak to average power ratio (PAPR) and its typical value in an OFDM system specified per IEEE 802.11a specifications. What is PAPR? The peak to average power ratio for a signal is defined as , where corresponds to the conjugate operator. Expressing in deciBels, .
When QAM (Quadrature Amplitude Modulation) is used, typically one may find a scaling factor associated with the constellation mapping operation. It may be reasonably obvious that this scaling factor is for normalizing the average energy to one. This post attempts to compute the average energy of the 16-QAM, 64-QAM and M-QAM constellation (where is a…
This is the first post in the series discussing receiver diversity in a wireless link. Receiver diversity is a form of space diversity, where there are multiple antennas at the receiver. The presence of receiver diversity poses an interesting problem – how do we use ‘effectively‘ the information from all the antennas to demodulate the…