Coding is a technique where redundancy is added to original bit sequence to increase the reliability of the communication. In this article, lets discuss a simple binary convolutional coding scheme at the transmitter and the associated Viterbi (maximum likelihood) decoding scheme at the receiver. Update: For some reason, the blog is unable to display the…
Question 3 on Communication from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q3. In a baseband communications link, frequencies upto 3500Hz are used for signalling. Using a raised cosine pulse with 75% excess bandwidth and for no inter-symbol interference, the maximum possible signaling rate in symbols per second is, (A)…
Understanding gradients is essential in machine learning, as they indicate the direction and rate of change in the loss function with respect to model parameters. This post covers the gradients for the vanilla Linear Regression case taking two loss functions Mean Square Error (MSE) and Mean Absolute Error (MAE) as examples. The gradients computed analytically…
In the previous post on Batch Gradient Descent and Stochastic Gradient Descent, we looked at two iterative methods for finding the parameter vector which minimizes the square of the error between the predicted value and the actual output for all values in the training set. A closed form solution for finding the parameter vector is possible, and in this post…
Some among you will be aware that in a wireless link having multiple antenna’s at the receiver (aka receive diversity) improves the bit error rate (BER) performance. In this post, let us try to understand the BER improvement with receive diversity. And, since we are just getting started, let us limit ourselves to additive white…
Equivalence of Moving Average and CIC filter Let me briefly share my understanding on the cascaded integrator comb (CIC) filter, thanks to the nice article. For understanding the cascaded integrator comb (CIC) filter, firstly let us understand the moving average filter, which is accumulation latest samples of an input sequence .
In a multi class classification problem, the output (also called the label or class) takes a finite set of discrete values . In this post, system model for a multi class classification with a linear layer followed by softmax layer is defined. The softmax function transforms the output of a linear layer into values lying…
Given that we have went over the symbol error probability for 4-PAM and symbol error rate for 4-QAM , let us extend the understanding to find the symbol error probability for 16-QAM (16 Quadrature Amplitude Modulation). Consider a typical 16-QAM modulation scheme where the alphabets (Refer example 5-37 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]). are used.
My friend Mr. Balaji volunteers for Vibha, a non-profit organization whose mission is to ensure that every underprivileged child attains his or her right to education, health and opportunity. Vibha, which was founded in 1991 has a volunteer network of 825 members spread across Atlanta, Austin, Bay Area, Boston, Chicago, Dallas, Houston, Jacksonville, Los Angeles,…
An important milestone for the dspLog happened on Oct 21st 2008. On this day last year, the blog migrated from the Blogger platform to the independently hosted platform at www.dsplog.com ! Belated birthday wishes for the blog!!! 🙂 Looking back, the first year was satisfying – both in terms of contents and traffic. We started…
Question 25 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q25. If , then the value of is, (a) (b) (c) (d) 1
The post on thermal noise described the noise produced by resistor ohms over bandwidth at temperature Kelvin. In this post, let us define the noise voltage at the input and output of a resistor network and further use it to define the Noise Figure of such a network.
An earlier post we discussed hard decision decoding for a Hamming (7,4) code and simulated the the bit error rate. In this post, let us focus on the soft decision decoding for the Hamming (7,4) code, and quantify the bounds in the performance gain.
In this post, let us try to derive the symbol error rate for 16-PSK (16-Phase Shift Keying) modulation. Consider a general M-PSK modulation, where the alphabets, are used. (Refer example 5-38 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]) Figure: 16-PSK constellation plot