Using Toeplitz matrices in MATLAB
The definition of Toeplitz matrix from [1] is: A matrix is said to be Toeplitz if the elements are determined completely by the difference .
Read More
Viterbi with finite survivor state memory
In the post on Viterbi decoder and soft input Viterbi decoder, we discussed a convolutional encoding scheme with rate 1/2, constraint length and having generator polynomial and having generator polynomial . If the number of uncoded bits is , then the number of coded bits at the output of the convolutional encoder is . Decoding…
Summary – feedback on [dspLog], July 2008
On July30th, 2008 I had sent a request for feedback to 93 subscribers who have opted to receive articles over email. As on 3rd August, I received the response from around 8 persons. Not bad, around 8.5% response. Thanks a lot for the feedback. I will summarize the response from the group and note down…
TETRA Air interface specifications – Overview
TETRA (TErrestrial Trunked RAdio) is a wireless specification intended to be used by government agencies, public health services, rail transport, military etc. TETRA specification comes from ETSI (European Telecommunication Standards Institute). We plan to start a post series on the building blocks of TETRA physical layer and radio specifications and this is the first post…
Chi Square Random Variable
While trying to derive the theoretical bit error rate (BER) for BPSK modulation in a Rayleigh fading channel, I realized that I need to discuss chi square random variable prior. What is chi-square random variable? Let there be independent and identically distributed Gaussian random variables with mean and variance and we form a new random…
Non coherent demodulation of pi/4 DQPSK (TETRA)
In TETRA specifications, one of the modulation technique used is Differential Quaternary Phase Shift Keying (DQPSK). We will discuss the bit error rate with non-coherent demodulation of DQPSK in Additive White Gaussian Noise (AWGN) channel.
Transmit beamforming
In this post lets discuss a closed-loop transmit diversity scheme, where the transmitter has the knowledge of the channel. As there is a feedback path required from the receiver, to communicate the channel seen by the receiver to the transmitter, the scheme is called closed-loop transmit diversity scheme. Recall that the transmit diversity using Space…
Linear to log conversion
In signal processing blocks like power estimation used in digital communication, it may be required to represent the estimate in log scale. This post explains a simple linear to log conversion scheme proposed in the DSP Guru column on DSP Trick: Quick-and-Dirty Logarithms. The scheme makes implementation of a linear to log conversion simple and…
BER for BPSK in Rayleigh channel
Long back in time we discussed the BER (bit error rate) for BPSK modulation in a simple AWGN channel (time stamps states August 2007). Almost an year back! It high time we discuss the BER for BPSK in a Rayleigh multipath channel. In a brief discussion on Rayleigh channel, wherein we stated that a circularly…
Gradients for linear regression
Understanding gradients is essential in machine learning, as they indicate the direction and rate of change in the loss function with respect to model parameters. This post covers the gradients for the vanilla Linear Regression case taking two loss functions Mean Square Error (MSE) and Mean Absolute Error (MAE) as examples. The gradients computed analytically…
Hamming (7,4) code with soft and hard decoding
An earlier post we discussed hard decision decoding for a Hamming (7,4) code and simulated the the bit error rate. In this post, let us focus on the soft decision decoding for the Hamming (7,4) code, and quantify the bounds in the performance gain.
Migration to Who’s Who theme
After a gap of around 7 months, we decided to migrate to a new template (recall, last time we changed was in May 2008). The template which we decided to use is designed by Elegant Themes. They have a wide array of themes and I chose to use the Who’s Who theme.
Understanding an OFDM transmission
Let us try to understand simulation of a typical Orthogonal Frequency Division Multiplexing (OFDM) transmission defined per IEEE 802.11a specification. Orthogonal pulses In a previous post (here ), we have understood that the minimum frequency separation for two sinusoidals with arbitrary phases to be orthogonal is , where is the symbol period. In Orthogonal Frequency…
Stochastic Gradient Descent
For curve fitting using linear regression, there exists a minor variant of Batch Gradient Descent algorithm, called Stochastic Gradient Descent. In the Batch Gradient Descent, the parameter vector is updated as, . (loop over all elements of training set in one iteration) For Stochastic Gradient Descent, the vector gets updated as, at each iteration the…