From the post on Closed Form Solution for Linear regression, we computed the parameter vector which minimizes the square of the error between the predicted value and the actual output for all values in the training set. In that model all the values in the training set is given equal importance. Let us consider the case where it is known…
Coding is a technique where redundancy is added to original bit sequence to increase the reliability of the communication. Lets discuss a simple binary convolutional coding scheme at the transmitter and the associated Viterbi (maximum likelihood) decoding scheme at the receiver. Update: For some reason, the blog is unable to display the article which discuss…
When QAM (Quadrature Amplitude Modulation) is used, typically one may find a scaling factor associated with the constellation mapping operation. It may be reasonably obvious that this scaling factor is for normalizing the average energy to one. This post attempts to compute the average energy of the 16-QAM, 64-QAM and M-QAM constellation (where is a…
As on 21st October 2007, we moved from blogspot domain at to the self hosted domain at https://dsplog.com. Over the last two years, the blog has grown quite a bit, and am reasonably happy with the progress. Let us look back at the positives and negatives over the last year.
Following the request by Siti Naimah, this post discuss the bit error probability for coherent demodulation of binary Frequency Shift Keying (BFSK) along with a small Matlab code snippet. Using the definition provided in Sec 4.4.4 of [DIG-COMM-SKLAR]), in binary Frequency shift keying (BFSK), the bits 0’s and 1’s are represented by signals and having…
Following discussion of bit error rate (BER) for BPSK and bit error rate for FSK, it may be interesting to move on to discuss a higher order constellation such as Pulse Amplitude Modulation (PAM). Consider that the alphabets used for a 4-PAM is (Refer example 5-34 in [DIG-COMM-BARRY-LEE-MESSERSCHMITT]).
In DSP-Proakis, I found the problem 2.56 interesting as it provides insight into delta modulation. The task is to show that, where is any discrete time signal and is the unit step function.
In this post, we will derive the theoretical equation for bit error rate (BER) with Binary Phase Shift Keying (BPSK) modulation scheme in Additive White Gaussian Noise (AWGN) channel. The BER results obtained using Matlab/Octave & Python simulation scripts show good agreement with the derived theoretical results. System Model Transmitter With Binary Phase Shift Keying…
Understanding gradients is essential in machine learning, as they indicate the direction and rate of change in the loss function with respect to model parameters. This post covers the gradients for the vanilla Linear Regression case taking two loss functions Mean Square Error (MSE) and Mean Absolute Error (MAE) as examples. The gradients computed analytically…
Are you bothered by speed of the speed of the simulations which you develop in Matlab/Octave? I was not bothered much, till I ran into the Viterbi decoder. If you recall, the Matlab/Octave simulation script for BER computation with hard soft decision Viterbi algorithm provided in post Viterbi with finite survivor state memory took around…
In TETRA specifications, one of the modulation technique used is Differential 8 Phase Shift Keying (D8PSK). We will discuss the bit error rate with non-coherent demodulation of D8PSK in Additive White Gaussian Noise (AWGN) channel.
Question 46 on math from GATE (Graduate Aptitude Test in Engineering) 2012 Electronics and Communication Engineering paper. Q46. The maximum value of in the interval [1, 6] is (A) 21 (B) 25 (C) 41 (D) 46 Solution Let us start by finding the critical points of the function . The first derivative is, . Solving by…